Find Jobs
Hire Freelancers

Migrate a database to support data warehousing, OLAP and big data

$30-250 AUD

В роботі
Опублікований about 5 years ago

$30-250 AUD

Оплачується при отриманні
This project aims to transform an existing database to support analytical processing (OLAP) for a data-warehouse that holds a huge amount of data and streams more data on daily basis. The analytical tasks are mostly statistical such as mean, variance, normalization, standardization, max, min, median. The challenge here is that the nested queries and the big data make the response time too slow and consumes lots of computational power that takes the server down. The requirement here is : 1. Propose a solution to make these reports more efficient in a way that allows the site to load in less than a second 2. evaluating the performance of current queries 3. Install and configure the necessary needed software to the server (if any) 4. Migrate the database from the current DBMS (MySQL) to the new DBMS 5. Migrate the views and nested queries in the current database to be efficiently implemented in the new database 6. Review each SQL statements to and propose how it can be optimized to run in the most efficient way 7. Create and optimize materialized views + triggers as needed 8. optimize the performance of the migrated database The deliverable: A new database to be used by the website with response time less than 3 seconds. I will just change the connection string in my site to connect to the new database and it should load the same data from the same views as fast as it can. The new database should be able to handle huge amounts of data (more than 30 million records) Obviously, MySQL does not support nested select statements, so many queries are just created to be used by the end queries for business. The business queries used by the site are listed at the end of the attached document. These queries must be created by the same names in the new database. The other internal queries used implicitly by the main queries can be traced through the code or listed from MySQL Before awarding the project, I will have a chat with each applicant to discuss the proposed solutions, the data warehousing experience and query optimization method.
ID проекту: 18770030

Про проект

18 пропозицій(-ї)
Дистанційний проект
Активність 5 yrs ago

Хочете заробити?

Переваги подання заявок на Freelancer

Вкажіть свій бюджет та терміни
Отримайте гроші за свою роботу
Опишіть свою пропозицію
Реєстрація та подання заявок у проекти є безкоштовними
18 фрілансерів(-и) готові виконати цю роботу у середньому за $415 AUD
Аватарка користувача
Hello, I have checked the project requirements. We can discuss further in more details on this task. Thanks.
$250 AUD за 5 дні(-в)
5,0 (25 відгуки(-ів))
6,2
6,2
Аватарка користувача
Hello, I can work on this project. I have much experience working with Data Warehousing. I worked on Target's Store-BI DTK Toolkit with Data Stage as ETL processes, Hyperrol as Multi-Dimmension Data Cubes (OLAP engine) that help reports, and j2ee for the BI reports (200+ report pages with 5000+ online management users) , Database uses IBM DB2 and Oracle. (Target Stores have about 1800+ Brick-Mortar retail stores located throughout the United States) Best Regards, An Ho
$155 AUD за 3 дні(-в)
4,7 (2 відгуки(-ів))
3,7
3,7
Аватарка користувача
I have more than 18 years of experience working on highly regulated environments and supporting large scale database installations. I am here to help you. Please contact me to learn more details about the project. I have careful reviewed the attachment. The
$1 666 AUD за 15 дні(-в)
4,8 (1 відгук)
2,9
2,9
Аватарка користувача
Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks
$55 AUD за 1 день
5,0 (2 відгуки(-ів))
3,0
3,0
Аватарка користувача
We DataLamp, is a Big Data company which works in Java, Data-Pipeline, BI/Visualisation/Reporting & Recommendation solutions. We also provide optimisation in existing architectural design for better performance. We have done projects in which we were supposed to optimise data warehouse response time. Last project to optimise queries of data warehouse was of a telecommunication in which we optimise the queries response time to 1-3 sec which was 30-40 sec. Would look forward to your reply where our solution architect will interact with you. Regards DataLamp
$277 AUD за 3 дні(-в)
5,0 (1 відгук)
1,0
1,0
Аватарка користувача
Hi, I have 7+ year of experience in database development and BI implementation. Mostly I worked with Pentaho business suits and most of RDBMS databases. According to my personal experience I suggest you to choose HP vertica db. It has columnar storage support which provides high throughput in aggregating/ analytical queries. It is free till 1tb of storage. Let's have a call for understanding your requirement. I am sure that we will have a good and mutual beneficiary conversation.  Hoping to talk with you soon. Thanks.
$890 AUD за 10 дні(-в)
5,0 (1 відгук)
1,1
1,1
Аватарка користувача
Hello We are team of smart developers working in IT industry from past 7-years have developed 200+ simple and complex Mobile phone apps for Android & iPhone, Hybrid app and many Websites in RubyOnRails,WordPress , Dot Net and PHP with a wide range of different features and technologies. Our area of expertise includes Android, iPhone, RubyOnRails, AngularJs, Dot Net , Postgresql, SQl Server, PHP, HTML, Graphics designs etc. Supportive - 24 full-time employees - Full-time customer care - Unlimited design options and revisions - 110% satisfaction guarantee Specialization - Website designing ( E-commerce, Static and Dynamic, Cryptocurrency) -CRM design - Logo design - Illustration - Packaging - Print Design - Animated Videos - brochure design We offer customized and high-quality design services at affordable prices. We promise quick turnaround times, great customer service and 100% original designs ! Thank you!
$250 AUD за 3 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
Hi I am data engineer with 4+ years of experience. I have worked on analytics solutions using both clouds and on premises. I have experience in bi, dwh and big data. Relevant Skills and Experience Proposed solutions 1. Optimize the way we store data that is store in unnormalized way to make retrieval fast 2. Offload the data processing and bring back the data in prepared form for query
$500 AUD за 10 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
Hello , I’m excited to share with you the proposal for this project. As I understand about your project it's truly challenging. I'll assure you that this project will complete within promise day. I’m truly excited to be working with you on your new logo redesign. I look forward to your response. All the best, Soumya
$166 AUD за 9 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
- 7.8 Years of onshore and offshore experience in EIM Technology, specializing in OLAP, ETL, Informatica, IBM DB2, Tableau, Quality Centre, Microsoft Sql Server, JIRA, Data Analysis, Alteryx. - Having a good understanding of Data Warehousing fundamentals including Dimensional Modeling. - Experience for 2 big 4 companies.
$277 AUD за 3 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
Hello, Hope you are doing great ! As per your requirements, I saw a 50+ Tables where your destination source will fetch the data and you require a Analytical Database for this perpose. I having a 2+ years of experience in Data warehouse and Analytics as well as I'm a System Architect and have a experience of GCP platform. I have a solutions for your requirements. Regards Rahul Singh
$333 AUD за 10 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
I have gone through your requirement and I have done similar projects in past. The requirement is similar to what I am doing right now. we have a MySQL OLTP which we have migrated to postgresql. We have build DWH with dimensions and few facts based on reports also build aggregation and summary tables instead of using procedures. The ETL tool which I have been using is pentaho community edition. I hope I am pretty much fit to your requirement.
$777 AUD за 15 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
I will improve your system for the lowest possible price for you! I am researching working with big data as a project in my life and would really love to work on this project to endue more knowledge of subclosed data! ~Greetings from a bigdata fan Joeri m. van Velzen
$35 AUD за 0 день
0,0 (0 відгуки(-ів))
0,0
0,0

Про клієнта

Прапор AUSTRALIA
Geelong, Australia
4,9
37
Спосіб оплати верифіковано
На сайті з лют. 14, 2006

Верифікація клієнта

Дякуємо! Ми надіслали на вашу електронну пошту посилання для отримання безкоштовного кредиту.
Під час надсилання електронного листа сталася помилка. Будь ласка, спробуйте ще раз.
Зареєстрованих користувачів Загальна кількість опублікованих робіт
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Завантажуємо для перегляду
Дозвіл на визначення геолокації надано.
Ваш сеанс входу закінчився, і сеанс було закрито. Будь ласка, увійдіть знову.