BitTorrent Throttling: Interview With Gemini Project

Written by enigmax on April 02, 2008 

Every week there is more controversy as ISPs continue to limit, throttle and otherwise interfere with P2P traffic. For those people who think their ISP is meddling with their traffic, there is a new system available to confirm it. TorrentFreak catches up with the creators of Gemini Project.

Gemini

For years now, many ISPs have sought to limit P2P traffic as they try to reduce bandwidth consumption due to their lack of preparation for the online video and music sharing boom. When it was first revealed that Comcast had been using hacker techniques to limit the effectiveness of BitTorrent traffic, there was quite an uproar and this even led to a FCC hearing.

Of course, it’s not just Comcast messing with transfers, there are many other ISPs around the world using a wide range of techniques to limit P2P traffic. As file-sharers become more aware that ISPs aren’t necessarily giving their subscribers what they hoped they’d already paid for (unlimited traffic etc), slow speeds or erratic transfers often raise suspicions of meddling.

However, ISPs aren’t forthcoming about these activities so asking them often gets people nowhere. Now, thanks to some new software, file-sharers can find out for themselves. TorrentFreak caught up with P2PForum.it and the Gemini Project for the low-down.

TF: What was the inspiration for Gemini Project? Who chose this project name and why?

[_SHIN_]: Well… as to the first part of the question, we can’t but think of a negative inspiration. We’re referring to the much-trumpeted slogan “Internet without limits” dominating the ads for almost all the ISPs. What makes it negative is the fact that the slogan is all about false promises masking a real inability of the providers to recognize the natural evolution of the transmissions over the Internet. Inability that becomes unsustainable when it comes to adjust the physical structures to the ever-developing nature of Internet communications. We all know there’s a general discrimination against peer-to-peer.

The aim of our project is to help the users lamenting over filters and slow downs to find evidence of ISP manipulations.

As to the name, «Gemini» stands for the synchronized activity of the two systems (Gemini A and Gemini B), where the first knows exactly what to expect from the latter, and vice versa.

TF: When did work on the Gemini Project begin? Who is involved and how much time has been spent?

[_SHIN_]: Neither the core application nor the method which that is based upon are original creations by p2pforum.it: we’ve just limited ourselves to put some points of the EFF detailed guide into practice, always keeping in mind that in order to check ISP filters, there needs to be a traceable communications between two hosts, with a given ISP in between.

In about a month, some members of p2pforum.it staff had discussed and technically developed the project. The point we’ve worked on most has been the creation of a system that would be simple for newbies to use while preserving those requirements pointed out by the EFF as necessary in order to get valid, non-altered results.

The test ambiance requires a definite setup that’s overtly invasive, as it involves installing softwares of packet inspection and analysis, disabling NAT and firewall, modifying the configuration for Ethernet cards, and so on.

We thought the best solution was to use a Live operating system in two versions, with the needed software and analysis tools already installed on it, so that users would not have to intervene too much in the process.

TF: Would you tell us a little about the technical aspects of the project, such as the software/systems used and why they were chosen?

[_SHIN_]: The operating system we used as a base is Ubuntu Gutsy Gibbon 7.10, on which we’ve pre-installed and configured the following elements: Wireshark, a BitTorrent client/tracker, a ZIP file containing mp3 to be transferred from A to B, pcapdiff. We’ve chosen BitTorrent protocol because it is, as far as we know, one of the most filtered, together with the eMule network.

TF: How does the system work?

[_SHIN_]: Each Gemini user launch his/her version of the system (A or B) and type the other user’s IP address. When the two systems locate one another’s presence, clocks are synchronized (via time server) and network-card setups are performed, and the requirements for a valid test (NAT and firewall disabled) are checked. If all the requirements are met, Gemini_A creates the .torrent file out of the ZIP, generating the tracker and the seed.

Gemini_B starts the download. Transmission is recorded on both hosts using Wireshark. After a predetermined period (the default is 4 minutes), Gemini_A sends Gemini_B the Wireshark log, so that Gemini_B can perform a traffic comparison through pcapdiff, producing a final report.

TF: How can the users interpret the data they get from these tests?

[_SHIN_]: The final report is a text file that’s easy enough for an ordinary user to interpret. We’d say it’s self-explanatory. The report shows:
- the overall number of sent/received packets
- the number of forged packets
- the number of dropped packets.

The number of dropped packets should be relatively low, while the number of forged packets should approach zero. Whoever performs the test and needs help to interpret the results, is invited to open a thread in the forum dedicated to Gemini Project – we’ll help them to understand if his/her ISP is really jamming peer-to-peer traffic.

TF: Thanks for taking the time to speak with us. Do you have anything to add?

[_SHIN_]: There are other things (i.e extensions to the python pcapdiff script, new methods of analysis, etc.) we’re planning to develop and include into coming versions of the project. But improvements and add-ons will depend on community interest and Gemini circulation.

Further information and operating details are available on the forum.

The Gemini ISOs can be downloaded from P2PForum.it

Gemini A and Gemini B

Previously: Most Popular DVDrips on BitTorrent (wk13)

Next: Movie Director Says it is OK to Pirate His Movie

34 Responses

1 Apr 02, 2008 at 16:14 by Ano

Superb article…

What todays torrent community want…
We all want to check whether our connection…are throttled by isp…
Superb…

http://www.hack5.blogspot.com

2 Apr 02, 2008 at 17:04 by Tweek

Looks very generic, although would this be possible on Windows?

Since it is one of the most common OS.

3 Apr 02, 2008 at 17:23 by dandin1

It’d be cool if they created a system to collect data and detect ISP, automatically matching users for test depending on what data is missing.

4 Apr 02, 2008 at 19:03 by Jag

Its clear that the ISP users are saying… dont F with our traffic, its just those corporate bastards keep turning a deaf ear… gotto hit them on the head with something and make them use their good ear… then if only we could make them use a good brain our job would be done.

http://www.ezee.se/

5 Apr 02, 2008 at 19:04 by I Suck Balls

Yeah, just thought I’d post a wank comment to allow me to plug a crap link no-one’s really interested in!

http://anothershittyblog.bloggyblogland.stfu/

6 Apr 02, 2008 at 19:11 by Fin Kin

Interesting project though I guess it doesn’t cover bandwidth throttling though?

I think it could be good if it could be expanded to include A/B tests utilizing differing protocols for per-protocol comparissons. I would not be surprised to see many ISPs biasing protocols according to their personal preferences (this is actually the case with many as is well known). I’m pretty sure you’d find many have traffic policies running that they don’t advertise to their subscribers and which are not immediately obvious like packet data manipulation/spoofing.

7 Apr 02, 2008 at 19:56 by rocky racoon

#2 if you look on their forum it appears that they just use a ubuntu live cd so you can use it on your pc.

8 Apr 02, 2008 at 20:02 by find-a-peer

wheres the server that continually acts as a G/A or a G/B?? Like i can call my tech challenged friends and say.. ok. Insert the cd. Boot the cd. What? Push teh delete key then. Go to …

sounds like the project is ALMOST there.

9 Apr 02, 2008 at 20:24 by Paco420

its a scam… they know a good portion of the people downloading this program to check isp throttling will be part of the p2p users and are planning on tracing everyones activity once you have it installed and your ip has been confirmed with mac address. DO NOT TRUST THESE BASTARDS. They are the reason ISP have the technology to throttle, they are just as worthless as the anti piracy groups themselfs.

10 Apr 02, 2008 at 20:52 by ARAGORN II

Ho partecipato in piccola parte al progetto Gemini e sinceramente mi dispiace molto che ci siano alcuni di voi che disprezzano così tanto il lavoro di altre persone (#9), spero di sbagliarmi o di aver capito male.

In caso di chiarimenti potete rivolgervi senza problemi su p2pforum.it

11 Apr 02, 2008 at 21:06 by Scary Herman

Paco420: what evidence do you base those beliefs on?

12 Apr 02, 2008 at 21:12 by RB

This is great but why did they use such a huge and bloated distro to start with, surely something like dsl would have been much better?

13 Apr 02, 2008 at 21:13 by Will

Dear Paco420, maybe you haven’t undrestood the finality of the project.

For explanations of the projet, you can explain your doubts in the Gemini project section on p2pforum.it

Bye

14 Apr 02, 2008 at 22:09 by Anonymous

too much work, they should make a version for stoners

15 Apr 02, 2008 at 23:20 by Rekrul

So basically, it’s not something that you can just download and use, you have to set up a whole specilized system, configure it for your ISP, etc.

16 Apr 02, 2008 at 23:32 by Paco420

The proof you are looking for will be released in due time. As for joining the forum I have joined and have been a member for quite some time now.
Paco420 who?

17 Apr 02, 2008 at 23:52 by Jasper van Weerd

I have read the setup, want to test it,, buts its not possible here, since I am in a student appartment.

18 Apr 03, 2008 at 01:11 by Anonymous

just a quick question off topic, where exactly is libble hosted???

19 Apr 03, 2008 at 04:04 by Peter

[quote comment="327448"]Yeah, just thought I’d post a wank comment to allow me to plug a crap link no-one’s really interested in!

http://anothershittyblog.bloggyblogland.stfu//quote
^^- LOL

20 Apr 03, 2008 at 08:45 by ace hall

too hard to use, i’m too dumb to use this kind of thing.

i want something to download,

install

sitback

get result.

make something like that !

21 Apr 03, 2008 at 08:49 by ace hall

is the 25 comments perpage thing still on ?

22 Apr 03, 2008 at 08:54 by ace hall

u kno,since it has been made 25comments/page, making the 25th comments is just like emptying the coffee jug without making some more coffee.

rude !

23 Apr 03, 2008 at 08:56 by ace hall

or using the last roll of toilet paper with replacing a new roll.

rude but sickly sastifying.

24 Apr 03, 2008 at 11:09 by Belligerent Engine

Using Ubuntu as the base is a nice idea. One could perform these tests with nothing but a wired internet connection, a computer and a bootable CD: no need to install anything on the hard drive.

25 Apr 03, 2008 at 11:40 by Watice

I don’t know if this method would really prove that an ISP is intentionally blocking traffic as dropped packets are pretty normal when it comes to p2p traffic.

26 Apr 03, 2008 at 12:57 by obzervur

OT: hey just noticed your showing 24 entries on page 1 but clicking page 2 shows 26 onwards. clicking show all shows the correct numbering.

i know its a minor thing but i’m easily confused! lol

27 Apr 03, 2008 at 18:30 by Scientology is the devil

It would be cool if these people just gave it a rest and left p2p alone entirely

28 Apr 03, 2008 at 20:35 by Paco420

New evidence showing that team members of the Gemini Project are linked in helping the FBI in “Operation FastLink” along with other operations currently under way to attempt to stop file sharing.

29 Apr 03, 2008 at 23:09 by hotdog

Damn, this “x comments per page” is hella – annoying!!!
I like the old way; I like people’s comments as much as the stories!!!!

GIVE US AN ALL-AT-ONCE back, please; its a little bit of gluttony, but its way more fun, interesting, and human!!!

Good article on the Gemini project; a majority of us are windows users though, and a minority are computer programmers (or at least, play with our computers:P), so could you update when the software gets simplified and modded to work with Windows? Might be nice if there was a way we could test it without installing on two computers, too; I don’t have two computers. I figure the developers are working on that too, but could you let us know when they get it working?

Thanks for the story TF!
(and please fix the commenting!)

30 Apr 03, 2008 at 23:11 by hotdog

[quote comment="330048"]New evidence showing that team members of the Gemini Project are linked in helping the FBI in “Operation FastLink” along with other operations currently under way to attempt to stop file sharing.[/quote]

a-yo; I am perfectly willing to consider “new evidence”; but first I am going to have to confirm that its source is reliable.
No offense, but you are an anonymous person making a comment;
that ONE HUNDRED PERCENT absolutely does not count as a credible source, nor “confirmed”.

31 Apr 06, 2008 at 01:38 by torhacker

for those using libtorrent, try out the ratio multiplier patch, located at http://torfighter.nfshost.com — you can add a multiplier to your upload amount.

32 Apr 06, 2008 at 12:19 by Stand

[quote comment="330048"]New evidence showing that team members of the Gemini Project are linked in helping the FBI in “Operation FastLink” along with other operations currently under way to attempt to stop file sharing.[/quote]

Excuse me, but what would be this “new evidence”?
Have you any proves?

33 Apr 06, 2008 at 13:58 by very

this software is too complicated. i wish they had developed an easier one for end users. If u don’t believe me, checkout their website: http://www.p2pforum.it/forum/showthread.php?t=290321

34 Apr 15, 2008 at 14:15 by p2psearch

http://searchp2p.weebly.com

Responses are closed

All remaining responses will continue to be archived. Use the TorrentFreak forums if you want to discuss something.