Stream a large json file s3 into postgres from java

Закрито Опубліковано %project.relative_time Оплачується при отриманні
Закрито Оплачується при отриманні

I need help with streaming a large json file from s3 into a postgres table from java.

I have a working solution in python but I want to get it done using java

The basic idea is we get mutiple gzipped json files into our s3 from a third party provider.

I want to be able to process those files and load them into postgres without downloading the entire file into the memory

If we can get 1 file work that way we can then look into multithreading

The crux of it is read the content from gzipped json in s3 without downloading the entire file into the memory

More info: [login to view URL]

Java J2EE Архітектура ПЗ PostgreSQL AWS Lambda JSON PostgreSQL Administration PostgreSQL Programming

ID Проекту: #32171658

Про проект

35 заявок(-ки) Дистанційний проект Остання активність 2 роки(ів) тому

35 фрілансерів(-и) готові виконати цю роботу у середньому за $564

AwaisChaudhry

Hi, I have read the details I believe I can do this job. While I believe I have some queries which need to be clarified. For that I would request you to start the chat so we could clarify those. We can discuss the time Більше

$1650 USD за 30 дні(-в)
(127 відгуків(и))
8.7
ahmedbilal2506

Hi sir I am interested to work with you. I can provide you professional web design services. I can design for you according to your requirements. I will give you unlimited revision until you will not satisfy for your d Більше

$250 USD за 2 дні(-в)
(120 відгуків(и))
6.2
apgrl123

hi, i have rich experienced of java/javafx so that i can give you the perfect result. java/javafx is my top skill and i am majoring it for over 6 years. i have completed the several projects already so i have confiden Більше

$500 USD за 7 дні(-в)
(23 відгуків(и))
6.4
ayesha0124

Hi there, How r u? I bid as i believe that I can help you with this project as i have the experience with PostgreSQL, Java, Software Architecture, AWS Lambda and J2EE. here is my portfolio: https://www.freelancer.com/u Більше

$750 USD за 28 дні(-в)
(7 відгуків(и))
5.2
oxankaorb

Hello, Thank you for your job posting. I have good experience to work with streaming large json file from s3 bucket in AWS. As a 5 yrs experience with software development, work with medium and big companies in russia. Більше

$500 USD за 7 дні(-в)
(7 відгуків(и))
5.3
hsh564cf84accd96

We will do your Json work I am writing this proposal in order to work for you in Software and Web Development. We are highly trained professional developers seeking to freelance and earn online. Having a flair in prog Більше

$400 USD за 7 дні(-в)
(20 відгуків(и))
5.1
oleksdevr

Strong java and python are required skills for your project. I will do your task in really short period. Let us discuss this soon.

$750 USD за 7 дні(-в)
(15 відгуків(и))
5.6
SpencerLuo

Hi I have read your project description and I'm pretty sure I can complete your project in the deadline. I would like to discuss more details via chat. Thanks, Luo

$500 USD за 7 дні(-в)
(6 відгуків(и))
4.6
Koki1216

Hi Vivek, this is Koki from Jp and I am familiar working with python/java as well as AWS s3 storage too. I have understood your requirement so send me the one sample file and the demo account for testing if you can do Більше

$700 USD за 7 дні(-в)
(4 відгуків(и))
4.8
ivanovatale

I’m an IOI/APIO (International Olympiad in Informatics, Asia Pacific Olympiad in Informatics) medalist and ICPC (International Collegiate Programming Contest) semifinalist. I have 2 years experience in coaching informa Більше

$500 USD за 7 дні(-в)
(4 відгуків(и))
4.5
RomanMatveev1

A Java Expert! Hello, dear client! Hope you are doing well. I have checked your requirements. Your project is not difficult for me at all. Please check my reviews to see my ability. Best regards for you!

$350 USD за 3 дні(-в)
(14 відгуків(и))
4.2
gregtechnola9

Hello, Greetings for the day!!! I have gone through your requirement and understood every aspect of them. I can fulfill your requirement flawlessly. I have more than 4 years of experience with happy clients. I ass Більше

$750 USD за 30 дні(-в)
(9 відгуків(и))
4.4
umairkaramat24

Hi! How are you doing? I have read the project description and really interested in this job, I have 4 years’ experience doing similar jobs regarding to these skills AWS Lambda, Java, PostgreSQL, J2EE and Software Arch Більше

$750 USD за 14 дні(-в)
(10 відгуків(и))
4.0
vladilavsuhovoy1

Hello ! I am skilled Python developer. I am familiar with Python and I have a lot of work experiences in Java, J2EE, PostgreSQL, AWS Lambda and Software Architecture. I can start right away. I want to discuss for thi Більше

$500 USD за 5 дні(-в)
(2 відгуків(и))
3.2
tblome

Hello, I'm a Senior Java Backend Software Developer with 15 years of experience. What would be the requested deliverable? A Java library (.jar) that you can use in another project, or a standalone (web-) application? I Більше

$500 USD за 7 дні(-в)
(1 відгук)
3.0
oleksandrscherb7

Hi I read your proposal and I am confident this job. I know Postgres very well. Please discuss more details via chat. Thank you.

$500 USD за 3 дні(-в)
(3 відгуків(и))
3.2
perezmirabile

Hello, i am a system engineer (I have a software factory micro company, and have a lot of help from my partners) We can have a call if you consider. Thanks for your time

$500 USD за 7 дні(-в)
(2 відгуків(и))
2.5
ToBeFree

Hello, I have all the skills and experience to do this work and in the best way/conditions. For me, the client / employer is completely satisfied or reimbursed Best regards,

$250 USD за 7 дні(-в)
(1 відгук)
1.8
igorkasatkinweb

Hi, *@Your best fit Here!!@* I’ve read your brief very carefully and I see I can do this as you want prefect. I think I am best suitable for your job, so don't waste time finding other developer. I have strong experien Більше

$300 USD за 7 дні(-в)
(1 відгук)
1.0
sujitnss

I'm a student working as AWS intern in Amazon Development Center. The requirement is not very clear. My understanding is as follows: 1. Read compressed json files from s3. The connectivity depends on the project. thi Більше

$700 USD за 14 дні(-в)
(0 відгуків(и))
0.0