В работе

Migrate a database to support data warehousing, OLAP and big data

This project aims to transform an existing database to support analytical processing (OLAP) for a data-warehouse that holds a huge amount of data and streams more data on daily basis. The analytical tasks are mostly statistical such as mean, variance, normalization, standardization, max, min, median. The challenge here is that the nested queries and the big data make the response time too slow and consumes lots of computational power that takes the server down.

The requirement here is :

1. Propose a solution to make these reports more efficient in a way that allows the site to load in less than a second

2. evaluating the performance of current queries

3. Install and configure the necessary needed software to the server (if any)

4. Migrate the database from the current DBMS (MySQL) to the new DBMS

5. Migrate the views and nested queries in the current database to be efficiently implemented in the new database

6. Review each SQL statements to and propose how it can be optimized to run in the most efficient way

7. Create and optimize materialized views + triggers as needed

8. optimize the performance of the migrated database

The deliverable:

A new database to be used by the website with response time less than 3 seconds. I will just change the connection string in my site to connect to the new database and it should load the same data from the same views as fast as it can. The new database should be able to handle huge amounts of data (more than 30 million records)

Obviously, MySQL does not support nested select statements, so many queries are just created to be used by the end queries for business. The business queries used by the site are listed at the end of the attached document. These queries must be created by the same names in the new database. The other internal queries used implicitly by the main queries can be traced through the code or listed from MySQL

Before awarding the project, I will have a chat with each applicant to discuss the proposed solutions, the data warehousing experience and query optimization method.

Квалификация: Cassandra, Организация хранилищ данных, MongoDB, MySQL, PostgreSQL

Показать больше big data data warehouse architecture, data lake vs data warehouse, difference between hadoop and data warehouse, difference and similarities between data warehouse and database, data migration in hadoop, migrating data warehouse to hadoop, big data migration approach, difference between database and data warehouse pdf, migrate database oscommerce, flex3 database support, oracle database support time, technical specification document database support ecommerce web site, migrate database jevents, phpfox migrate database, Database support, quickbooks database data posted website, magento migrate database, database support services kolkata, clone joomla big data base, mangos project database support

О работодателе:
( 10 отзыв(-а, -ов) ) Geelong, Australia

ID проекта: #18770030

Поручен:

shinoys222

Hi, I am a backend developer with 4 years of experience in different web technologies and databases. I have worked with programming languages such as PHP, NodeJs, Python, Java, and databases such as Cassandra, MySQL, S Больше

$750 AUD за 15 дней(-я)
(2 отзывов(-а))
3.1

23 фрилансеров(-а) в среднем готовы выполнить эту работу за $395

digidreamstech

Hello, I have checked the project requirements. We can discuss further in more details on this task. Thanks.

$250 AUD за 5 дней(-я)
(23 отзывов(-а))
5.6
dhanuitdevendra

Hello, Hope you are doing well! We can help you with our Data Architect as a Service (ARCaaS). Please visit [login to view URL] for details. Please have a look at our existing customer base Больше

$70 AUD за 30 дней(-я)
(2 отзывов(-а))
4.0
hotranan

Hello, I can work on this project. I have much experience working with Data Warehousing. I worked on Target's Store-BI DTK Toolkit with Data Stage as ETL processes, Hyperrol as Multi-Dimmension Data Cubes (OLAP Больше

$155 AUD за 3 дней(-я)
(2 отзывов(-а))
3.7
RushService

Feel fee to contact me for Migrate a database to support data warehousing, OLAP and big [login to view URL] me message to discuss further more details .We provide the comments,images,videos,demos and live sessions in order Больше

$250 AUD за 3 дней(-я)
(3 отзывов(-а))
2.7
alexannick

I have more than 18 years of experience working on highly regulated environments and supporting large scale database installations. I am here to help you. Please contact me to learn more details about the project. Больше

$1666 AUD за 15 дней(-я)
(1 отзыв)
2.9
nirajvalam

Hi, I have 7+ year of experience in database development and BI implementation. Mostly I worked with Pentaho business suits and most of RDBMS databases. According to my personal experience I suggest you to choose HP Больше

$890 AUD за 10 дней(-я)
(1 отзыв)
1.1
CitachiTech

Hi there, Good Evening ! How are you? I see that you need a developer who is skilled in database migration. It seems like a very straightforward job, we can do this easily. I am Hardik Kotecha. I have close to 1 Больше

$277 AUD за 3 дней(-я)
(0 отзывов(-а))
0.0
himamahi09

Hi, Seeing the project description and requirement, I would suggest to migrate to PostgreSQL. I have experience of handling one OLAP of ~14TB on PostgreSQL with fact tables of size like > 100GB. I am able to achieve Больше

$1000 AUD за 15 дней(-я)
(0 отзывов(-а))
0.0
chaituthalikota

I have gone through your requirement and I have done similar projects in past. The requirement is similar to what I am doing right now. we have a MySQL OLTP which we have migrated to postgresql. We have build DWH with Больше

$777 AUD за 15 дней(-я)
(0 отзывов(-а))
0.0
techlinesols6

Dear Prospect Hiring Manager. Thank you for giving me a chance to bid on your project. i am a serious bidder here and i have already worked on a similar project before and can deliver as u have mentioned "I can do Больше

$208 AUD за 7 дней(-я)
(0 отзывов(-а))
0.0
techlinesols35

"Hi, Hope you are doing well! Thanks for sharing your project requirement with us. It will be our great pleasure to work on your project. I have checked your requirement, yes we can do it, because we already work on si Больше

$208 AUD за 7 дней(-я)
(0 отзывов(-а))
0.0
JhansiYarlagadda

I am working as Big data developer at arrow electronics USA. Please find my linkedln link [login to view URL]

$277 AUD за 3 дней(-я)
(0 отзывов(-а))
0.0
rahulsingh239ca

Hello, Hope you are doing great ! As per your requirements, I saw a 50+ Tables where your destination source will fetch the data and you require a Analytical Database for this perpose. I having a 2+ years of experien Больше

$333 AUD за 10 дней(-я)
(0 отзывов(-а))
0.0
devxterity

Hi there, Greetings!! I read your description carefully and assure you to provide you with website support and development services for your website as i am expert level developer and designer having 5+ years of ex Больше

$250 AUD за 3 дней(-я)
(0 отзывов(-а))
0.0
dineshrajputit

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with ha Больше

$55 AUD за 1 день
(0 отзывов(-а))
2.8
artirajora

Hello We are team of smart developers working in IT industry from past 7-years have developed 200+ simple and complex Mobile phone apps for Android & iPhone, Hybrid app and many Websites in RubyOnRails,WordPress Больше

$250 AUD за 3 дней(-я)
(0 отзывов(-а))
0.0
choudharyneeti11

- 7.8 Years of onshore and offshore experience in EIM Technology, specializing in OLAP, ETL, Informatica, IBM DB2, Tableau, Quality Centre, Microsoft Sql Server, JIRA, Data Analysis, Alteryx. - Having a good understan Больше

$277 AUD за 3 дней(-я)
(0 отзывов(-а))
0.0
DataLamp

We DataLamp, is a Big Data company which works in Java, Data-Pipeline, BI/Visualisation/Reporting & Recommendation solutions. We also provide optimisation in existing architectural design for better performance. W Больше

$277 AUD за 3 дней(-я)
(0 отзывов(-а))
0.0
soumyabratabat

Hello , I’m excited to share with you the proposal for this project. As I understand about your project it's truly challenging. I'll assure you that this project will complete within promise day. I’m truly excite Больше

$166 AUD за 9 дней(-я)
(0 отзывов(-а))
0.0
waseemsaleemg

Hi Dear, Our best concern is to follow your requirement and deadline and we will do our best for the success of your project. Feel free to send message to discuss your project with us. Thank you very much! Surely, we Больше

$155 AUD за 3 дней(-я)
(0 отзывов(-а))
0.0