AWS API/S3/Lambda Developer Needed

Established b2b company with local, COLO, cloud and virtualized services needs help on a special AWS project.

We need a multi-step utility/development project to utilize a few AWS services as part of a collective “project”.

What We Currently Do:

-We have hundreds of data partners. They provide us API endpoint access to download updated values/data.

- We invoke their API in a .NET solution.

- Response data is saved locally.

- We have to run multiple API GET’s, liken to looping through page=1, page=2 sometimes.

- Requires a good bit of computing power and resources, especially now that we are scaling.

What We Want:

- We want to invoke one (1) AWS API. By invoking this one API Endpoint all further processing will be done in AWS and return a “job status” code or results/total successful API’s, etc.

- We want to pass to AWS API a list of all API URL’s and/or path-variables and/or query string parameters.

- This batch list of urls that need to be invoked will be sent somehow to AWS, such as in a HTTPWebRequest Body (JSON).

- AWS wil have to “loop through” or “process” list of URL’s. I’m not sure if this is Lambada or Batch, there is no preference except light-weight and serverless.

- After AWS API returns a response (which is always in JSON format), we want each response saved as a .json file in an AWS S3 Bucket.

- A method to easily query/index S3 Bucket contents. Some buckets will have millions of files. We need to be able to quickly determine if a filename exists (CloudSearch?)


- You will have to create AWS API Gateway and simply the process for passing querystring parameters for each URL (example: zip = 24018, pagenum = 1)

- You will have to create AWS S3 Bucket and consider permissions, access, etc.

- You will have to create some sort of “job” or “batch” fuction that will tell AWS API to update each URL in the .json body.

- You will have to provide a simple and extremely responsive/quick way to return S3 Bucket file search properties.

- You will have to create a new IAM user just for this project.

- You must lock down the IAM user to only these resources.

- You must limit the region for the IAM user to have access to only US-East1.

- The IAM user will have rights to invoke AWS API, create/manage/run Lambda Functions and/or AWS Batch Jobs and S3 Bucket Read/Write permissions for the buckets that only pertain to this project.

Pseudo-Code Diagram

- Attached is a basic visual diagram of the flow/goal of thisi project. This is not meant to be static nor correct. We need help designing the most efficient and cost effective way to accomplish the goals outlined in the diagram.

- It is not mean to be “accurate”, rather an overview of what needs to happen and the net result of how to save the URL response data into S3 Buckets.

Квалификация: Интернет-услуги Amazon, Aws Lambda

Показать больше qbfc freelance developer needed, iphone developer needed, outsource developer needed, aws lambda s3 example java, aws lambda s3 python, aws lambda jobs, aws lambda write to s3 python, s3 trigger lambda example, aws lambda example, aws lambda s3 example, aws lambda read file from s3, cakephp developer needed, php oscommerce developer needed, ajax developer needed, flash games developer needed, delphi developer needed, magento website developer needed, mmorpg developer needed, aspnet developer needed, joomla developer needed

О работодателе:
( 0 отзыв(-а, -ов) ) Waxhaw, United States

ID проекта: #18116064

9 фрилансеров(-а) в среднем готовы выполнить эту работу за $621


Hi nice to meet you thanks for visitting my profile. I think you must do it by batch job. because the lambda has limition for 300s with more than 9 year in aws. So I can help you. can we talk?

$300 USD за 10 дней(-я)
(18 отзывов(-а))

amazon web services expert

$500 USD за 1 день
(30 отзывов(-а))

Hi there, Though there're several points we need to discuss in detail for the moment the requirements look quite clear and straighforward to implement. Apparently, the main operation is not compute bound but rath Больше

$1000 USD за 10 дней(-я)
(13 отзывов(-а))

Hello. I have extensive experience in AWS Lambda, S3 bucket and Api Development. I have done a lot of AWS project and Lambda Projects. I will provide good result. thank you

$500 USD за 10 дней(-я)
(2 отзывов(-а))

Hi I am certified aws solution architect with 3+ years of industry experience. I have been working on deploying highly scalable, available, fault-tolerant and optimized solutions using aws clouds. I actually found your Больше

$500 USD за 10 дней(-я)
(6 отзывов(-а))

Hi, I went through the requirement and what I feel is you need an async api which has to call multiple rest api's and store the result in some persistent store like dynamo db or S3. Couple of things which will help Больше

$497 USD за 10 дней(-я)
(7 отзывов(-а))

************************************************************************************************************************************************************************************************************************** Больше

$750 USD за 20 дней(-я)
(0 отзывов(-а))

Hello there, We are a team of AWS experts with more than 12 years of rich industry experience .We provide DevOps as a service to wide variety of companies ranging from Small Scale to large organisations. Followin Больше

$555 USD за 10 дней(-я)
(0 отзывов(-а))

I'm working with AWS for 5 years, and currently studying to get my AWS Solutions Architect certification. I'm ready to solution your project and deliver a working cloud application as outlined in the provided doc. I do Больше

$988 USD за 10 дней(-я)
(0 отзывов(-а))