| *** balleyne has joined #cc | 00:02 | |
| *** balleyne has quit IRC | 00:31 | |
| *** JED3 has quit IRC | 01:03 | |
| *** pyrak has quit IRC | 01:16 | |
| *** mralex has quit IRC | 01:24 | |
| *** stevel has quit IRC | 01:56 | |
| *** pyrak has joined #cc | 02:27 | |
| *** pvh has quit IRC | 02:41 | |
| *** pyrak has quit IRC | 03:00 | |
| *** pvh has joined #cc | 03:34 | |
| *** pyrak has joined #cc | 05:04 | |
| *** pyrak has quit IRC | 05:30 | |
| *** sparr has joined #cc | 05:51 | |
| *** JoiIto has joined #cc | 05:52 | |
| *** pyrak has joined #cc | 06:05 | |
| *** pyrak_ has joined #cc | 06:06 | |
| *** pyrak has quit IRC | 06:14 | |
| *** Kaetemi__ has quit IRC | 06:38 | |
| *** JoiIto has quit IRC | 07:00 | |
| *** wormsxulla has joined #cc | 07:10 | |
| *** wormsxulla_ has quit IRC | 07:12 | |
| *** pyrak_ has quit IRC | 07:50 | |
| *** pvh has quit IRC | 07:54 | |
| *** michi has joined #cc | 09:34 | |
| *** michi has quit IRC | 10:30 | |
| *** Kaetemi has joined #cc | 12:21 | |
| *** JoiIto has joined #cc | 14:05 | |
| *** tvol has joined #cc | 14:10 | |
| *** nkinkade has joined #cc | 14:45 | |
| *** mlinksva has joined #cc | 15:05 | |
| *** shellac has joined #cc | 15:12 | |
| *** shellac has quit IRC | 15:15 | |
| *** shellac has joined #cc | 15:16 | |
| *** JED3 has joined #cc | 15:42 | |
| *** shellac has quit IRC | 15:50 | |
| *** rejon1 has joined #cc | 16:11 | |
| rejon1 | 32 people in here! | 16:11 |
|---|---|---|
| rejon1 | crazy | 16:11 |
| rejon1 | i'm pounding arabica coffee with bassel | 16:12 |
| *** mecredis_ has joined #cc | 16:14 | |
| *** bassel1 has joined #cc | 16:16 | |
| bassel1 | Heya | 16:16 |
| *** rejon1 has quit IRC | 16:18 | |
| *** rejon has joined #cc | 16:18 | |
| *** pyrak_ has joined #cc | 16:24 | |
| *** rejon has quit IRC | 16:28 | |
| *** rejon has joined #cc | 16:29 | |
| *** JED3 has quit IRC | 16:32 | |
| *** wormsxulla has quit IRC | 16:32 | |
| *** wormsxulla has joined #cc | 16:34 | |
| *** nathany has joined #cc | 16:34 | |
| *** tvol has quit IRC | 16:40 | |
| nkinkade | nathany: paster (cc.engine) seems to be running out of control. | 16:45 |
| nkinkade | (on a5) | 16:45 |
| nathany | nkinkade, did you restart it? | 16:46 |
| nkinkade | nathany: Not yet. I thought you might want to look at if first. | 16:47 |
| nkinkade | Not sure if there is some live troubleshooting you can do or if a restart is the only thing. | 16:47 |
| nathany | nkinkade, unfortunately not much in the way of live troubleshooting unless it's enabled (and enabling it makes it slower, use more memory for profiling) | 16:47 |
| nkinkade | htop is a nice tool. | 16:48 |
| nathany | wow, that is cool | 16:48 |
| nkinkade | nathany: The chooser still seems to be having trouble. Are you looking at it? | 17:00 |
| nathany | nkinkade, i just noticed that | 17:00 |
| nathany | yes, looking | 17:00 |
| *** stevel has joined #cc | 17:02 | |
| *** Yanroy has joined #cc | 17:04 | |
| *** Yanroy has left #cc | 17:04 | |
| *** JED3 has joined #cc | 17:05 | |
| *** jwyg has joined #cc | 17:11 | |
| *** JoiIto has quit IRC | 17:16 | |
| *** JustJohnny68 has joined #cc | 17:21 | |
| *** jwyg has quit IRC | 17:32 | |
| nathany | nkinkade, i upped the size of the threadpool on cc.engine, that seems to have helped a little, but it's still getting hit pretty hard | 17:33 |
| nathany | guess we'll just keep an eye on it | 17:33 |
| *** shellac has joined #cc | 17:38 | |
| k9d-925 | there's a concert tonight with several creative commons artists in san francisco | 17:38 |
| k9d-925 | http://6.media.tumblr.com/tumblr_ksfkvkXbC61qa98l8o1_500.gif | 17:38 |
| *** akozak has joined #cc | 17:39 | |
| nathany | nkinkade, have we see xhtml for jordan yet? | 17:40 |
| nkinkade | nathany: Not yet. | 17:41 |
| nathany | sigh | 17:41 |
| nathany | ok | 17:41 |
| rejon | bassel1 is next to me. he is working on it furiously :) | 17:42 |
| rejon | i have an ak47 to his head | 17:43 |
| nathany | RME | 17:43 |
| bassel1 | hahahahhahaha | 17:43 |
| rejon | bassel1 is the pressure point to apply to get that html done...go bassel go | 17:43 |
| bassel1 | I'm on to it now, will finish soon | 17:44 |
| nathany | it won't be the first launch to happen without published licenses :) | 17:44 |
| nkinkade | nathany: What is RME? | 17:49 |
| nkinkade | Receptor-mediated endocytosis? | 17:49 |
| k9d-925 | my name is jordan | 17:49 |
| nathany | rolling my eyes | 17:49 |
| nkinkade | rejon seems to provoke that in you frequently :-) | 17:50 |
| *** balleyne has joined #cc | 17:50 | |
| nathany | autonomic reaction | 17:50 |
| *** mralex has joined #cc | 17:50 | |
| nkinkade | SYN_RECV: 59 | 17:51 |
| nkinkade | ESTABLISHED: 5699 | 17:51 |
| nkinkade | TIME_WAIT: 3563 | 17:51 |
| nkinkade | FIN_WAIT1: 152 | 17:51 |
| nkinkade | FIN_WAIT2: 24 | 17:51 |
| nkinkade | Total unique connections: 6643 | 17:51 |
| nkinkade | That is on a5. | 17:51 |
| rejon | whatever. bye. | 17:55 |
| *** rejon has left #cc | 17:55 | |
| nathany | nkinkade, hrm; that seems like... a lot. | 18:01 |
| nkinkade | It does seem fairly high, but Apache is handling it okay, apparently. | 18:01 |
| nkinkade | Total throughput is steady around 600KB/s | 18:01 |
| nathany | that's good (that apache is handling it), I guess | 18:02 |
| nkinkade | I take that back ... it's now down around 350K/s | 18:02 |
| nkinkade | It seems to be something in cc.engine that is getting bogged down. | 18:04 |
| nkinkade | [273986.182886] paster[8806] general protection ip:7fc5d367c90b sp:4bb25f30 error:0 in etree.so | 18:04 |
| nkinkade | [274456.367599] paster[7542]: segfault at 6e0000005f | 18:04 |
| nkinkade | And the paster process seems to be using nearly 100% of the available CPU cycles. | 18:05 |
| nathany | nkinkade, i'm going to run cc.engine in the foreground for a bit, see if i can get that exception | 18:08 |
| *** jgay has joined #cc | 18:12 | |
| *** pyrak_ is now known as pyrak | 18:13 | |
| pyrak | k9d-925, hey buddy | 18:13 |
| pyrak | i need to get ready for class, but let's catch up some time | 18:14 |
| k9d-925 | for sure pyrak ! | 18:20 |
| k9d-925 | i'm trying to get the cc friends out to a chiptune event tonight but everyone in the chan is too busy working to chat with me about it | 18:20 |
| *** tvol has joined #cc | 18:23 | |
| nathany | hi k9d-925 -- i looked @ the poster but unfortunately have class tonite | 18:24 |
| k9d-925 | yo nathany ! yeah it's too bad the party is kind of an early one ... but most the time people make the excuse they can't be out late on a work night ... lesson learned is that no matter what time you make a party, some people will miss it =) | 18:25 |
| nathany | right :) | 18:26 |
| *** akozak has quit IRC | 18:44 | |
| *** pyrak has quit IRC | 18:53 | |
| *** nkinkade has quit IRC | 18:57 | |
| *** Saqib has joined #cc | 19:03 | |
| Saqib | Hello | 19:06 |
| nathany | hi Saqib | 19:06 |
| Saqib | May I know about development on Bangladesh jurisdiction ? | 19:09 |
| nathany | Saqib, you can find information about jursidiction developments to date at http://creativecommons.org/international | 19:10 |
| *** Saqib has left #cc | 19:10 | |
| nathany | if you'd like to inquire about starting the process for porting the licenses you can email michelle@creativecommons.org who can let you know what the requirements, etc are | 19:10 |
| *** nkinkade has joined #cc | 19:21 | |
| *** pyrak has joined #cc | 19:23 | |
| *** JoiIto has joined #cc | 19:41 | |
| nathany | paroneayea, i have some changes i'm making to the chooser and deed templates | 19:50 |
| nathany | should i just ping you when i commit those so you can incorporate them into your version if needed? | 19:50 |
| paroneayea | nathany: sure, sounds good | 19:51 |
| *** bassel1 has quit IRC | 19:53 | |
| *** jgay has quit IRC | 20:09 | |
| nkinkade | nathany: Anything come of running cc.engine in the foreground? It still seems to be hammered. | 20:38 |
| *** [mharrison] has quit IRC | 20:46 | |
| *** [mharrison] has joined #cc | 21:03 | |
| *** akozak has joined #cc | 21:10 | |
| *** pyrak has quit IRC | 21:11 | |
| nathany | nkinkade, no, i put it back in the background, didn't see anything interesting | 21:22 |
| nathany | i wish we could see what URLs are getting requested from Zope | 21:23 |
| nathany | see if there's any information there... | 21:23 |
| nkinkade | nathany: Point your browser at http://creativecommons.org/server-status | 21:31 |
| nkinkade | It's not exactly what you want, but there will be some URLs in the list. | 21:32 |
| nathany | nkinkade, that's 404 for me | 21:32 |
| *** shellac has quit IRC | 21:32 | |
| nkinkade | How about http://a5.creativecommons.org/server-status | 21:32 |
| nathany | fwiw i figured out how to put a logging shim into cc.engine, setting it up now so i can take a peek | 21:32 |
| nathany | that works | 21:32 |
| *** balleyne has quit IRC | 21:33 | |
| nathany | nkinkade, of course, that doesn't actually show zope requests since we short circuit those in varnish, right? | 21:33 |
| nkinkade | nathany: Good point. | 21:34 |
| nkinkade | Duh. | 21:34 |
| nathany | :) | 21:34 |
| nathany | nkinkade, so we're getting hammered with requests like: | 21:40 |
| nathany | 127.0.0.1 - - [12/Nov/2009:15:39:34 -0500] "GET /%2B%2Bvh%2B%2Bhttp%3Acreativecommons.org%3A80/%2B%2B/choose/results-one?license_code=by-sa&jurisdiction=-&version=3.0&lang=en HTTP/1.0" 200 11219 "-" "-" | 21:40 |
| *** nathany has quit IRC | 21:41 | |
| *** nathany has joined #cc | 21:41 | |
| nathany | nkinkade, did that log line come through the channel? | 21:42 |
| nkinkade | nathany: Yeah, it did. | 21:42 |
| nkinkade | Is that a valid request? | 21:42 |
| nathany | /choose/results-one?license_code=by-sa&jurisdiction=-&version=3.0&lang=en is the relevant part | 21:42 |
| nathany | yeah | 21:42 |
| nkinkade | Is there any indication in the request where it came from. | 21:42 |
| nathany | none | 21:43 |
| nathany | no user-agent, no referrer | 21:43 |
| nathany | is it possible to do logging out of varnish to find out what IP it's might be coming from? | 21:43 |
| nkinkade | nathany: And normally those headers would be exposed to Zope? | 21:43 |
| nathany | at least UA would be; when i make the request from my desktop i can see my UA scroll by | 21:43 |
| nkinkade | nathany: Let me see what I can come up with. | 21:43 |
| nathany | thanks | 21:43 |
| nkinkade | nathany: I think we'll be able to use varnishncsa to look at live requests. | 21:44 |
| nathany | nkinkade, cool | 21:45 |
| nathany | we're getting more than one per second for that address, which seems pretty bogus to me. | 21:45 |
| nkinkade | nathany: So actually it's a simple as: | 21:45 |
| nkinkade | $ sudo varnishncsa | 21:46 |
| *** JustJohnny68 has left #cc | 21:46 | |
| nkinkade | You can try to see the blur go by, or you can pipe it to some file to inspect after a sufficient amount of requests have been captured. | 21:46 |
| nathany | nkinkade, can you block 94.23.237.227? | 21:47 |
| nkinkade | nathany: Sure. One sec. | 21:48 |
| nathany | thanks | 21:48 |
| nkinkade | nathany: Done. And things are already starting to calm down on the machine. | 21:50 |
| nathany | yeah, pretty dramatic drop-off | 21:50 |
| nathany | (i've got varnishncsa running through a grep filter for the results URL) | 21:50 |
| nkinkade | nathany: I had noticed that host (ns209070.ovh.net) factoring pretty heavily iftop earlier. | 21:51 |
| nathany | huh | 21:51 |
| nathany | ok, i need to restart cc.engine in the background with logging disabled | 21:51 |
| *** nathany has quit IRC | 21:53 | |
| *** nathany has joined #cc | 21:53 | |
| nathany | nkinkade, things seem a bit calmer; let me know if i should look @ it again | 21:55 |
| nathany | btw, are the connections from that IP just dropped? | 21:55 |
| nkinkade | nathany: Thanks for tracking that down. I wonder how long we should leave that rule in place. | 21:56 |
| nkinkade | ? | 21:56 |
| nkinkade | I set it to DROP packets from that IP. | 21:56 |
| nathany | it looks like a virtual host provider | 21:56 |
| nathany | as opposed to an ISP-handed out IP | 21:56 |
| nkinkade | I could possibly have it send a RST | 21:56 |
| nathany | nkinkade, let's do the thing that uses the least resources on our end (which I suspect is DROP) :) | 21:56 |
| nathany | can you make a reminder to look at it on monday? | 21:57 |
| nkinkade | Yeah, DROP doen't even bother to be friendly, and is the least resource intensive. | 21:57 |
| nathany | try removing the rule and see if it spikes again | 21:57 |
| nkinkade | Fuck the fucking fucker is my thought. | 21:57 |
| nkinkade | :-) | 21:57 |
| nathany | yeah, pretty much | 21:57 |
| nkinkade | (to quote from the audio clip on "The Word Fuck") | 21:57 |
| nathany | LOL | 21:57 |
| nkinkade | It's true, you can use it as almost every word in a sentence. | 21:57 |
| nathany | if their use was legit/important, they should at least set a user-agent | 21:57 |
| nathany | i know i like to :) | 21:58 |
| nkinkade | I'll make a note to myself to get rid of that rule tomorrow sometime. For all we know it's a dynamic address that will be handed out to someone legitimate at some point. | 21:58 |
| nathany | right | 21:58 |
| nathany | and now i know how to inspect varnish and zope a little better | 21:59 |
| *** bassel has joined #cc | 22:05 | |
| *** [mharrison] has quit IRC | 22:14 | |
| tvol | this IRC log reads like air traffic control. i love it. | 22:34 |
| nathany | tvol, thanks, i think | 22:37 |
| paroneayea | hopefully the suicide rate is not as comparable for the kind of work involved | 22:38 |
| *** tvol has quit IRC | 22:43 | |
| JED3 | why is it that Flickr will include photos on their homepage marked as being CC'd but then the photographers have all rights reserved when you view the photo at its canonical url? | 22:43 |
| JED3 | I assume its the creators editing the rights to the photo after the fact, but am curious if this issue has ever been noted or discussed? | 22:44 |
| JED3 | sorry if it has been already, but I just discovered this for myself | 22:44 |
| greg-g | JED3: I've noticed it a lot and I'm not sure if it is the authors changing it after the fact or flickr just being dumb | 22:45 |
| *** [mharrison] has joined #cc | 22:54 | |
| *** JoiIto has quit IRC | 23:21 | |
| *** pyrak has joined #cc | 23:30 | |
| *** nkinkade has quit IRC | 23:41 | |
| *** mlinksva has quit IRC | 23:45 | |
Generated by irclog2html.py 2.6 by Marius Gedminas - find it at mg.pov.lt!
