Find Jobs
Hire Freelancers

Data Engineering Projects needed - with Databricks and dbt - Need Pyspark/Spark Scala, SQL and python

₹12500-37500 INR

Закрито
Опублікований 2 months ago

₹12500-37500 INR

Оплачується при отриманні
I need complete 2 small projects done. The data needs to be pulled from API using python. The pulled data needs to be unnested, then transformed to answer some insights with medallion architecture. Here, you need to showcase SCD-type 2 ingestions, incremental joins, managing PII information, aggregation. Final deliverable needed for 1st project (databricks): Data model designed and architecture overview Notebooks of transformations in Python and PySpark/Spark Scala Final deliverable needed for 2nd project (dbt): Data model designed and architecture overview dbt sql and yaml files
ID проекту: 37847697

Про проект

16 пропозицій(-ї)
Дистанційний проект
Активність 1 mo ago

Хочете заробити?

Переваги подання заявок на Freelancer

Вкажіть свій бюджет та терміни
Отримайте гроші за свою роботу
Опишіть свою пропозицію
Реєстрація та подання заявок у проекти є безкоштовними
16 фрілансерів(-и) готові виконати цю роботу у середньому за ₹23 113 INR
Аватарка користувача
Hello, I read through, and I can help out. I am a seasoned Python developer, and with my skill set, you can entrust me with 100% project delivery. I have a deep understanding of Python and libraries like Pandas, Numpy, Scipy, Plotly, scikit, re, poetry, etc. Kindly text me over the chats so we can discuss further. Thank you Note: Bid Amount and timeline is just a placeholder; actual value would be provided after 1 on 1 discussion over chat.
₹25 000 INR за 7 дні(-в)
5,0 (8 відгуки(-ів))
4,2
4,2
Аватарка користувача
Hi, i'm data engineer with more 6 years in the area of big data. I have experience working with scala and python. I can help you with this project. Write me and talk me about the detail of project.
₹16 800 INR за 7 дні(-в)
4,8 (13 відгуки(-ів))
3,2
3,2
Аватарка користувача
Utilizing my current skills in web development, I have been exploring the Kaggle dataset primarily with SQL. My affinity for learning new things and adapting to the latest trends aligned serendipitously with your project's requirements of Databricks, dbt, PySpark, Spark Scala, and Python. Therefore I am confident in my ability to complete both projects competently and punctually. Beyond this alignment of skills, my experience in designing and developing databases gives me an insightful perspective on data engineering projects such as yours. Within this domain, I have proven abilities in unnesting data, incorporating SCD-type 2 ingestions, implementing incremental joins, managing PII information efficiently and handling complex aggregations. In conclusion, though my background may differ somewhat from a typical data engineer's profile, I can offer you a fresh perspective that combines creativity with technical expertise. I am ready to dive into your projects headfirst, guaranteeing meticulous attention to details alongside superb final deliverables including a comprehensive data model design and architecture overview plus well-structured and efficient notebooks or sql/yaml files. With me as part of your team on this project, you can rest assured that your data will be managed accurately and transformed effectively to reveal valuable insights.
₹25 000 INR за 1 день
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
Hello ChirpyGreetings, I am Sadat Saeed, with 8 years of experience in Python and SQL. I have carefully read your project requirements for data engineering using Databricks and dbt. I will pull data from APIs using Python, unnest and transform it to showcase SCD-type 2 ingestions, incremental joins, managing PII information, and aggregation. The final deliverables will include data models, architecture overview, and transformation notebooks in Python and PySpark/Spark Scala for the first project, and dbt SQL and yaml files for the second project. Please review my portfolio https://www.freelancer.ca/u/DGM999 and let's discuss further. Best regards, Sadat Saeed
₹35 000 INR за 8 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
I have total 8 years of experience in oracle sql and plsql Creating procedure, cursor ,functions, Views, index , complex views, trigger , Analytical function, aggregate function.
₹25 000 INR за 7 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
my name is Azam im student now i live in China as possible i will help u if it possible send me details . its my first work in this web site in past i have a lot of projekts with it , also i had programmers team
₹25 000 INR за 7 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
I am particularly excited about the opportunity to work on projects involving medallion architecture, slowly changing dimension (SCD) type 2 ingestions, incremental joins, managing personally identifiable information (PII), and aggregation. I believe my experience in these areas, combined with my passion for data engineering and problem-solving, make me a strong candidate for this role. Thank you.
₹12 500 INR за 15 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
Data engineer with 7 years of experience using Python and spark, I already define data pipelines architecture one of that was able to process more than 500gb
₹37 500 INR за 7 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
Hello, I hope you are doing well, I'm available to work on this project, please contact me so we can discuss the specifications. Regards
₹20 000 INR за 7 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
Hi I have experience working with python , Databricks would accomplish your both the projects . hoping to start working soon with u
₹12 500 INR за 7 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
I have working experience of 2 years in Big Data field, i have worked on Spark/SparkSql, python, Hadoop, Hive.
₹13 000 INR за 8 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
Hi Greetings! We are a team of software developers. We have developers working on almost all the technologies. We will assign you a project manager who will assist you during the entire process of project completion. We will provide you with fast, timely, and on-time delivery at reasonable and minimum cost. We are a registered company located in Indore, India. We are available right now for the project discussion and can start the project on an immediate basis. We understand your project requirement We have 12 ++ years of experience in design and development. We can handle projects from small styling to full development from scratch. We will provide a good result in a short time and satisfy you fully. We have experienced developers in Python SQL Spark Data Modeling WHY-Us: » Ready to Start on an Immediate basis &provide proper Testing. » Keep your Data & Website Secure: Daily Progress Updates. » You will get 30 days FREE BUG-SUPPORT even after Project-Completion Please come in touch and let's discuss more detail about your task via chat. Project milestones will be decided during the chat. Thanks and Regards Tech India
₹37 500 INR за 5 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0

Про клієнта

Прапор INDIA
Tiruchi, India
0,0
0
Спосіб оплати верифіковано
На сайті з бер. 26, 2020

Верифікація клієнта

Дякуємо! Ми надіслали на вашу електронну пошту посилання для отримання безкоштовного кредиту.
Під час надсилання електронного листа сталася помилка. Будь ласка, спробуйте ще раз.
Зареєстрованих користувачів Загальна кількість опублікованих робіт
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Завантажуємо для перегляду
Дозвіл на визначення геолокації надано.
Ваш сеанс входу закінчився, і сеанс було закрито. Будь ласка, увійдіть знову.