| *** bassel has joined #cc | 00:23 | |
| *** jgay has joined #cc | 00:34 | |
| *** bassel has quit IRC | 00:36 | |
| *** mlinksva has quit IRC | 00:36 | |
| *** bassel has joined #cc | 00:45 | |
| *** bassel has quit IRC | 01:11 | |
| *** mlinksva has joined #cc | 01:32 | |
| *** thisisparker__ has joined #cc | 03:37 | |
| *** thisisparker_ has quit IRC | 03:40 | |
| *** mlinksva has quit IRC | 04:04 | |
| *** JED3 has joined #cc | 04:54 | |
| *** erlehmann has joined #cc | 06:57 | |
| *** wormsxulla has quit IRC | 07:15 | |
| *** wormsxulla has joined #cc | 07:31 | |
| *** thisisparker__ has quit IRC | 08:57 | |
| *** tantek has joined #cc | 08:58 | |
| *** thisisparker__ has joined #cc | 09:24 | |
| *** thisisparker__ is now known as thisisparker | 10:04 | |
| *** bassel has joined #cc | 10:10 | |
| *** Kaetemi has joined #cc | 10:54 | |
| *** jgay has joined #cc | 11:25 | |
| *** bassel has quit IRC | 11:37 | |
| *** tantek has quit IRC | 12:04 | |
| *** kreynen has joined #cc | 12:19 | |
| *** kreynen has quit IRC | 12:27 | |
| *** erlehmann has quit IRC | 12:27 | |
| * danbri wonders if there's a CC connection -- http://www.guardian.co.uk/media/2010/nov/01/tony-ageh-interview-bbc-archive | 12:33 | |
| *** oshani has joined #cc | 12:48 | |
| *** Kaetemi has quit IRC | 12:55 | |
| *** kreynen has joined #cc | 13:07 | |
| *** oshani has quit IRC | 13:21 | |
| *** erlehmann has joined #cc | 13:29 | |
| *** oshani has joined #cc | 13:30 | |
| *** bassel has joined #cc | 13:41 | |
| *** jgay has quit IRC | 14:03 | |
| *** tantek has joined #cc | 14:34 | |
| *** nkinkade has joined #cc | 15:09 | |
| *** mlinksva has joined #cc | 15:16 | |
| *** jgay has joined #cc | 15:28 | |
| *** oshani has quit IRC | 15:48 | |
| *** erlehmann has quit IRC | 15:55 | |
| *** mlinksva has quit IRC | 16:01 | |
| *** erlehmann has joined #cc | 16:09 | |
| *** balleyne has joined #cc | 16:20 | |
| *** danbri has quit IRC | 16:23 | |
| *** mralex has joined #cc | 16:41 | |
| *** akozak has joined #cc | 16:44 | |
| *** oshani has joined #cc | 16:47 | |
| *** danbri has joined #cc | 16:51 | |
| *** danbri has joined #cc | 16:51 | |
| *** JED3 has quit IRC | 17:11 | |
| *** bassel has quit IRC | 17:30 | |
| *** bassel has joined #cc | 17:39 | |
| *** thisisparker has quit IRC | 17:41 | |
| *** jgay has quit IRC | 17:46 | |
| *** JED3 has joined #cc | 17:49 | |
| *** tantek has quit IRC | 17:55 | |
| akozak | ugh, nkinkade I have an embarrassing request: could you reset my password on linode? I seem to have forgotten what I changed it to after that security issue a few weeks ago | 18:06 |
|---|---|---|
| akozak | not urgent | 18:06 |
| nkinkade | akozak: Look in /home/akozad/password | 18:08 |
| nkinkade | s/d/k/ | 18:09 |
| nkinkade | Of course, change that password, and you may as well delete that file too. | 18:09 |
| akozak | ok thank you nkinkade, done | 18:09 |
| *** bassel has quit IRC | 18:58 | |
| *** bassel has joined #cc | 19:01 | |
| *** tantek has joined #cc | 19:15 | |
| *** tantek has quit IRC | 19:17 | |
| *** mralex1 has joined #cc | 19:18 | |
| *** jgay has joined #cc | 19:29 | |
| *** thisisparker has joined #cc | 19:48 | |
| *** jgay has quit IRC | 19:55 | |
| *** Kaetemi has joined #cc | 20:04 | |
| *** wormsxulla has quit IRC | 20:13 | |
| *** balleyne has quit IRC | 20:19 | |
| akozak | nkinkade, I think the CC Staff Call Bot is offset by a week. | 20:19 |
| akozak | It just created a page for 11-10 | 20:20 |
| nkinkade | akozak: Is there a problem with that? | 20:21 |
| nkinkade | The email that went out seems right to me. | 20:21 |
| akozak | nkinkade, yea it's pretty inconsequential | 20:22 |
| nkinkade | akozak: How did you notice that it had created one for 11-10? Recent changes? | 20:22 |
| akozak | yes | 20:22 |
| nkinkade | Where does it show that the staff call bot made that change? | 20:23 |
| nkinkade | What it a long time ago? | 20:23 |
| akozak | nkinkade, no it just happened, make sure you have "Show bots" on | 20:24 |
| nkinkade | Ah. | 20:25 |
| nkinkade | I'll look at the code. | 20:25 |
| *** wormsxulla has joined #cc | 20:27 | |
| *** i386nix has joined #cc | 20:32 | |
| i386nix | i have float result; int value=569; result=(value/200);printf("%.2f",result); and i get 2.00 as a result as opposed to 2.84, why?? | 20:33 |
| *** i386nix has left #cc | 20:34 | |
| nkinkade | Okay. I think the code should now be updated to only try to create pages bi-weekly instead of every week for the staff call. | 20:37 |
| akozak | nkinkade, cool. i thought it had been doing that already though, just the wrong week cycle. | 20:39 |
| nkinkade | akozak: It was doing that already for sending out the emails, but apparently not with regard to creating the following week's page in advance. | 20:40 |
| nkinkade | Thanks for pointing that out. | 20:40 |
| akozak | oh ok. thanks nkinkade | 20:40 |
| *** lotia has quit IRC | 20:41 | |
| *** bassel has quit IRC | 21:12 | |
| *** bassel has joined #cc | 21:14 | |
| mralex | JED3: what's the canonical cc engine module in version control? | 21:42 |
| JED3 | mralex: cc.engine? | 21:43 |
| mralex | JED3: in svn or git? | 21:43 |
| JED3 | is that what you're asking? | 21:43 |
| JED3 | oh git | 21:43 |
| JED3 | nkinkade: ping | 21:43 |
| nkinkade | JED3: ? | 21:43 |
| JED3 | nkinkade: we're currently not rotating the vhost apache logs on scraper.cc.org, however the deedscraper is currently logging to 2 directories /var/log/deedscraper and the apache2 log dir | 21:45 |
| nkinkade | JED3: We are rotating the scraper logs. | 21:45 |
| nkinkade | I set that up last week. | 21:45 |
| JED3 | nkinkade: are you sure its rotating /var/log/apache2/scraper.creativecommons.org/* ? | 21:46 |
| nkinkade | JED3: No, you're right, not that one, but /var/log/deedscraper | 21:46 |
| JED3 | yeah... so the access log that we need is actually in the apache dir | 21:47 |
| nkinkade | I didn't know there was anything useful in the Apache one. | 21:47 |
| nkinkade | But we can do that one too. | 21:47 |
| JED3 | there is a file called access.log in the deedscraper dir, but its useless, an artifact from when we were using paste to serve up the api | 21:47 |
| nkinkade | Cool. Well, the Apache access.log should be rotated by default, but I can start archiving it too. | 21:48 |
| nkinkade | JED3: Is it possible to log everything to the the Apache log dir for that vhost? | 21:49 |
| JED3 | nkinkade: hmm yes, but, we might run into issues with permissions | 21:49 |
| nkinkade | JED3: Logrotate can set whatever permissions we want on the new logs. | 21:50 |
| nkinkade | User, mode, etc. | 21:50 |
| JED3 | the deedscraper needs to have the same suexec permissions as the scraper process, and the apache dir needs to be writable by apache | 21:50 |
| nkinkade | JED3: Actually Apache doesn't need write access ... all that is done as root. | 21:51 |
| JED3 | nkinkade: yeah, but apache wont be able to write to a directory thats john:users 744, and the scraper will fail if its logging directory are set to anything other than those permissions | 21:51 |
| nkinkade | JED3: I'm pretty sure that Apache logs as root, not www-data. | 21:52 |
| nkinkade | /var/log/apache2 is owned by root, as well as all the subdirectories. | 21:52 |
| JED3 | nkinkade: if thats true than it should be fine | 21:52 |
| JED3 | ahh okay | 21:52 |
| JED3 | lets try that then | 21:52 |
| nkinkade | JED3: Let's give it a go, because having all the logs in one place will make this easy, as well as keep the structure of the archive directories. | 21:52 |
| JED3 | should we reconfigure apache or deedscraper, which directory do you prefer? | 21:53 |
| nkinkade | I guess we want to make sure that deedscraper/access.log doesn't clobber the Apache one. | 21:53 |
| JED3 | nkinkade: i agree, which is why i brought this up | 21:53 |
| JED3 | i was going to go the sloppy route, but figured i better run it by you ;) | 21:53 |
| JED3 | nkinkade: yes thats another thing | 21:53 |
| nkinkade | JED3: It would be nice if everything was logged to /var/log/apache2/scraper.creativecommons.org | 21:53 |
| JED3 | i think i can removed the access.log configuration bit from the scraper | 21:54 |
| JED3 | nkinkade: then that directory will need to be john:users 744 | 21:54 |
| JED3 | can we do that? | 21:54 |
| nkinkade | That is, in there to have the normal Apache access.log and error.log but also have the metadata-scraper.log. | 21:54 |
| nkinkade | JED3: I'll set that up right now. | 21:54 |
| JED3 | ok | 21:54 |
| JED3 | i need to set up a separate vhost (and dns entry) for the testing version of the scraper | 21:56 |
| nkinkade | JED3: On second thought, I wonder if just using a symlink would be best? | 21:56 |
| JED3 | nkinkade: :/ i think it'd be simpler all in 1 directory if its possible | 21:57 |
| nkinkade | Making this work with john:users would require two separate logrotate scripts .. one for the scraper, and another for every other vhost. | 21:57 |
| nkinkade | The Apache logrotate script operates on /var/log/apache2/*, but we only care about scraper.CC.org. It's the only dir in there now, but it's possible that it won't always be. | 21:58 |
| JED3 | nkinkade: yah, i am about to add a new vhost right now... | 21:58 |
| nkinkade | JED3: What's the new vhost for? | 21:59 |
| JED3 | a staging version of the scraper | 21:59 |
| JED3 | i get nervous touching the production scraper | 21:59 |
| nkinkade | JED3: Ah. Okay. | 22:00 |
| *** Auria has joined #cc | 22:01 | |
| JED3 | speaking of which which is most preferable as its subdomain: scraper-test.creativecommons.org - zcraper.cc.org - scrapper.cc.org ? | 22:01 |
| nkinkade | JED3: You don't think that something like this would okay: | 22:02 |
| nkinkade | $ sudo ln -s /var/log/deedscraper/metadata.log /var/log/apache2/scraper.creativecommons.org/metadata.log | 22:02 |
| JED3 | or crapper.cc.org :P | 22:02 |
| nkinkade | :-) | 22:02 |
| nkinkade | Anything you like, really. | 22:02 |
| JED3 | crapper it is then | 22:02 |
| nkinkade | But how about the above symlink? | 22:02 |
| JED3 | nkinkade: i think that should work | 22:02 |
| nkinkade | I guess then rsync will have to dereference symlinks. Hmm. | 22:03 |
| JED3 | as long as its linked from apache to deedscraper like you have above | 22:03 |
| nkinkade | JED3: I guess the way we were doing it on a5 was fine, with the exception that we'll just need to know that the access.log that matters is the one in the Apache vhost. | 22:04 |
| nkinkade | The more I think about it, keeping this separate from Apache seems sort of nice, especially considering the issue of permissions. | 22:05 |
| akozak | nkinkade, do you mind if I assign a non-urgent request to upgrade maps/sem maps on the wiki to you? | 22:09 |
| JED3 | okay, so can we just rotate on both directories, and change the rsync to only grab /var/log/deedscraper/metadata* and /var/log/apache2/scraper.creativecommons.org/access* | 22:10 |
| *** Auria has left #cc | 22:10 | |
| JED3 | http://crapper.creativecommons.org/ i may get shit for this but i dont give a poot (puns absolutely intended) | 22:12 |
| nkinkade | JED3: Yeah, that sounds right. I'll limit the metadata rsync to only grab the metadata.log. | 22:16 |
| JED3 | nkinkade: awesome, thx | 22:16 |
| akozak | hahaha | 22:19 |
| *** oshani has quit IRC | 22:20 | |
| akozak | mralex, relevant to cc search? http://googlecode.blogspot.com/2010/11/introducing-google-apis-console-and-our.html maybe not since they already seemed to support api calls for cc licenses | 22:22 |
| mralex | hmm | 22:22 |
| akozak | unless the new cse api tools helps somehow | 22:22 |
| akozak | help* | 22:22 |
| mralex | might be able to add a more integrated search experience on cc.org | 22:23 |
| akozak | ah yea | 22:23 |
| akozak | that too | 22:23 |
| akozak | json output now for cse | 22:23 |
| akozak | wow the default limit for the custom search api is 100 queries a day | 22:26 |
| JED3 | Default limit: 100 queries/day | 22:26 |
| JED3 | ha yeah.. | 22:26 |
| JED3 | just saw that myself | 22:27 |
| mralex | lol | 22:27 |
| akozak | after that youve gotta find it your own damn self | 22:27 |
| JED3 | i'm surprised they arent selling credits | 22:28 |
| nkinkade | JED3: Are you doing something with /apps/deed? | 22:30 |
| nkinkade | Just a message it was down. | 22:30 |
| nkinkade | Just being sure. | 22:30 |
| JED3 | nkinkade: yes | 22:40 |
| *** thisisparker has quit IRC | 23:14 | |
| *** jgay has joined #cc | 23:17 | |
| *** jgay has joined #cc | 23:17 | |
| *** oshani has joined #cc | 23:25 | |
| *** jgay has quit IRC | 23:55 | |
| *** jgay_ has joined #cc | 23:55 | |
| *** erlehmann has quit IRC | 23:55 | |
Generated by irclog2html.py 2.6 by Marius Gedminas - find it at mg.pov.lt!