Amazon MWS PHP / NodeJS Guru Required

$10-30 USD

Завершено

Опублікований

over 8 years ago

$10-30 USD

Оплачується при отриманні

Hi, I have a web app built in PHP and am using the Amazon MWS API to query product data. I need to test the maximum number of ASINS that can be scraped per second, with a test data of 10,000 ASINS. (You can use 20 ASINs in one request) We are using the [login to view URL] service. I'm only looking for experienced developers who are familiar with Amazon API and who know how to run 10 requests per second (with 20 ASINs per request). So I am expecting approx 200 ASINs to be scraped per second with your test. The reason for this task, is because we can test 1000 ASINs just fine and they complete within 15 seconds but 2000 ASINs has a massive time increase. We don't know if it's the Amazon API that is causing this or beanstalkd which we are using to process multiple jobs at once. So for your test please use multi CURL or any similar technique to run 10 requests per second with 20 ASINs per request. 10000 (10 thousand) ASINs as your test data. You can use the same 20 ASINs over and over again in each request. Please write the word BANANA in your proposal so I know you are not a bot and have read this description :) I will leave an amazing 5 star feedback for a good job. I also need this done ASAP. Thanks

Amazon Web Services

Node.js

PHP

ID проекту: 8670958

Про проект

2 пропозицій(-ї)

Дистанційний проект

Активність 9 yrs ago

Хочете заробити?

Переваги подання заявок на Freelancer

Вкажіть свій бюджет та терміни

Отримайте гроші за свою роботу

Опишіть свою пропозицію

Реєстрація та подання заявок у проекти є безкоштовними

Доручений:

@Legendzrider

BANANA. I just wanted to make your life easier and let you know that the Amazon MWS api has throttling limits. [login to view URL] Basically a MWS throttling limit works like a bucket with a hole at the bottom. You can only submit requests as long as the bucket is not full. You are allowed an initial burst of requests to fill the bucket but them you must wait for the bucket to empty a bit before submitting more requests. For the request you are trying to make, Amazon lets you make up to 20 requests (with up to 20 items per request). That equates to 400 items processed instantly. Then the 'bucket' becomes full and you must wait for it to empty a bit before submitting more requests. The restore rate is 10 ITEMS per second. This essentially means you are allowed to scrape 10 items per second after the initial 400. This would equal 1000 items for the first minute and 600 items for every minute after that. At this rate you would finish scraping 10000 items in exactly 15 minutes. If you try to submit requests faster than this you will get a request throttled error and if you continue to do so, Amazon may choose to slow you down even if you are no longer hitting the throttling limit. Kind Regards, Suad Causevic *(I put a random price for the job because I didn't think it was necessary for you to pay someone for this information)

$10 USD за 5 дні(-в)