Search the web
Sign In
New User? Sign Up
ysearchboss · Yahoo! Search BOSS
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Want to share photos of your group with the world? Add a group photo to Flickr.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
Occasional-to-frequent 500 errors when querying the BOSS API   Topic List   < Prev Topic  |  Next Topic >
Reply | Forward  | 
Re: [ysearchboss] Re: Occasional-to-frequent 500 errors when querying the BOSS API


Dan,

Thank you for the very detailed information. That actually helped us a great deal, to investigate this further.

Regarding specifically the 500 error issue: We are going to make a change to BOSS early next week (I'll write another email here, once completed), and let's see if your 500 error rate then gets much better, after that.

Regarding the traceroute, the actual time/date of each traceroute doesn't match up with any known outage that I can find.  But I have one other aspect regarding this, which I would like to spend more time this Monday on, and get back to you.

Thanks Dan.  Stay tuned..
Jay



puckgod wrote:
 



Hi Jay,

I don't have the exact queries themselves, but I will in the future, I just wasn't logging that part before. Here are the traceroutes and times from this morning. All times listed are UTC.

From our Amsterdam location:
Nov 5 17:32:50 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 5 17:34:57 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 5 17:35:11 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 5 17:36:25 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 09:48:53 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 10:04:34 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 10:05:13 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 10:07:34 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 11:01:06 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 11:38:22 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 12:21:44 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 12:30:30 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 12:30:30 ERROR: Received http code 500 when trying to query Yahoo BOSS API.

There are many queries between these that are succeeding, it's not happening on every query.

Traceroute from Nov 6 14:06:

$ traceroute boss.yahooapis.com
traceroute to boss-api.a1.b.yahoo.com (98.136.114.186), 64 hops max, 52 byte packets
1 core-01-spl (93.184.209.49) 0.519 ms 0.183 ms 0.142 ms
2 ge-1-3-0.pat1.ams.yahoo.com (195.69.145.110) 0.604 ms 0.530 ms 0.967 ms
3 ge-0-2-0.pat2.ams.yahoo.com (66.196.65.71) 0.969 ms 0.721 ms 0.852 ms
4 so-3-1-0.pat1.the.yahoo.com (66.196.65.67) 6.536 ms 6.615 ms 6.477 ms
5 so-1-0-0.pat1.nyc.yahoo.com (66.196.65.13) 81.929 ms 81.811 ms 81.888 ms
6 so-3-0-0.pat1.dcp.yahoo.com (216.115.101.157) 94.899 ms 95.016 ms 96.574 ms
7 xe-9-0-0.msr2.ac2.yahoo.com (216.115.108.145) 94.713 ms 95.167 ms 95.046 ms
8 xe-7-2-0.clr3.ac4.yahoo.com (76.13.0.193) 95.140 ms 118.984 ms
xe-8-2-0.clr3.ac4.yahoo.com (76.13.0.105) 96.633 ms
9 te-9-1.bas-a1.ac4.yahoo.com (76.13.0.177) 95.429 ms 95.314 ms
te-8-1.bas-a1.ac4.yahoo.com (76.13.0.173) 95.748 ms
10 * * *
11 * * *

From our New York location:

Nov 5 17:32:24 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 03:01:29 ERROR: Received http code 500 when trying to query Yahoo BOSS API.
Nov 6 12:03:44 ERROR: Received http code 500 when trying to query Yahoo BOSS API.

Again, queries between these succeeded.

Traceroute from Nov 6 14:08:

$ traceroute boss.yahooapis.com
traceroute to boss-api.a1.b.yahoo.com (98.136.114.186), 64 hops max, 52 byte packets
1 core-01-nyc (72.21.95.177) 0.373 ms 0.199 ms 0.173 ms
2 207.88.182.69.ptr.us.xo.net (207.88.182.69) 0.391 ms 0.330 ms 0.296 ms
3 207.88.86.177.ptr.us.xo.net (207.88.86.177) 0.171 ms 0.306 ms 0.183 ms
4 207.88.15.21.ptr.us.xo.net (207.88.15.21) 0.238 ms 20.108 ms 0.245 ms
5 if-2-12.icore1.NTO-NewYork.as6453.net (209.58.26.69) 6.151 ms 6.434 ms 0.592 ms
6 if-13-0-0-475.core2.NTO-NewYork.as6453.net (216.6.97.89) 0.946 ms 0.620 ms
if-12-0-0-13.core2.NTO-NewYork.as6453.net (216.6.97.5) 1.072 ms
7 if-1-0-0.core3.AEQ-Ashburn.as6453.net (216.6.51.5) 6.180 ms 5.917 ms 5.915 ms
8 ix-3-0-2.core3.AEQ-Ashburn.as6453.net (63.243.149.122) 6.499 ms 6.476 ms 6.499 ms
9 ae-6.pat1.dcp.yahoo.com (216.115.102.174) 6.451 ms 173.219 ms 12.115 ms
10 xe-4-0-0.msr1.ac2.yahoo.com (216.115.108.139) 6.817 ms
xe-9-0-0.msr1.ac2.yahoo.com (216.115.108.141) 6.473 ms 6.563 ms
11 xe-7-2-0.clr4.ac4.yahoo.com (76.13.1.115) 6.573 ms
xe-4-2-0.clr4.ac4.yahoo.com (76.13.0.103) 6.566 ms
xe-4-2-0.clr3.ac4.yahoo.com (76.13.0.101) 6.815 ms
12 te-8-1.bas-a1.ac4.yahoo.com (76.13.0.173) 6.792 ms
te-8-1.bas-a2.ac4.yahoo.com (76.13.0.175) 6.788 ms
te-9-1.bas-a2.ac4.yahoo.com (76.13.0.179) 6.817 ms
13 * * *
14 * * *

Although I don't have the queries themselves, here's the format I'm using to query BOSS:

http://boss.yahooapis.com/ysearch/web/v1/SEARCHTERM?appid=APIKEY&format=json

Hope this helps,

-Dan

--- In ysearchboss@yahoogroups.com, BOSS User Group Support Team <boss-usergroup-support-team@...> wrote:
>
>
> Dan,
>
> If you could please provide the info mentioned in this past email from
> this user group, that would be helpful:
>
> http://tech.groups.yahoo.com/group/ysearchboss/message/1860
>
> thanks,
> Jay




Sat Nov 7, 2009 12:42 am

sboss64
Offline Offline
Send Email Send Email

Forward
 | 
Expand Messages Author Sort by Date

Hello, I recently started using BOSS for search on several servers located around the world, I'm using python's urllib2 to do the query and I'm seeing at least...
puckgod
Offline Send Email
Nov 5, 2009
3:09 pm

Dan, If you could please provide the info mentioned in this past email from this user group, that would be helpful: ...
BOSS User Group Suppo...
sboss64
Offline Send Email
Nov 5, 2009
11:17 pm

Hi Jay, I don't have the exact queries themselves, but I will in the future, I just wasn't logging that part before. Here are the traceroutes and times from...
puckgod
Offline Send Email
Nov 6, 2009
2:14 pm

Dan, Thank you for the very detailed information. That actually helped us a great deal, to investigate this further. Regarding specifically the 500 error...
BOSS User Group Suppo...
sboss64
Offline Send Email
Nov 7, 2009
12:42 am

Dan, The boss dev team is now instead investigating this further (below-mentioned change is on-hold), with some new discoveries that have come up, regarding...
BOSS User Group Suppo...
sboss64
Offline Send Email
Nov 11, 2009
12:22 am

Hi Jay, Sounds good. Just to update you on some changes I've made, I switched each site to using it's own API key rather than sharing one, and added caching...
puckgod
Offline Send Email
Nov 11, 2009
1:44 am

Dan, For the 5 most recent occurrences you have of any 5xx error code returned back from BOSS, could you please provide for us (and for *each* of these 5...
BOSS User Group Suppo...
sboss64
Offline Send Email
Nov 12, 2009
11:55 pm

Hi Jay, Here are our five most recent, all of which happened at our 2 Amsterdam nodes, though those also are the nodes doing the most queries to BOSS of our...
puckgod
Offline Send Email
Nov 13, 2009
7:44 pm

Dan, Thank you for the detailed information below. This is exactly what I was hoping to get back. I have now forwarded all of the below to the boss dev team,...
BOSS User Group Suppo...
sboss64
Offline Send Email
Nov 13, 2009
8:21 pm

Dan, Thank you for your patience. I wanted to quickly let you know that this has not been forgotten about. The BOSS dev team is still working on this, and...
BOSS User Group Suppo...
sboss64
Offline Send Email
Nov 20, 2009
10:03 pm

Dan, It turns out that all of these below queries / exact query times do not even appear in our BOSS logs, as even being received by us. (regardless of error...
BOSS User Group Suppo...
sboss64
Offline Send Email
Nov 23, 2009
8:23 pm
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help