Find Jobs
Hire Freelancers

Simple Oozie Job Dispatcher

£250-750 GBP

Завершено
Опублікований almost 7 years ago

£250-750 GBP

Оплачується при отриманні
>>> About Me I'm an IT contractor working on a Hadoop project for one of my clients. I'd like some help to accelerate the delivery. >>> The Job Implement the following using Oozie in Cloudera CDH 5.8.3 Oozie must watch for a file arriving in a local directory d with a mask m. The value for d and m should be configurable. Example values are: d: /tmp m: customer_????????.txt where ? means any character. File-watching must use built-in Oozie features. An example would be Oozie's file coordinator. Hand-coded file watching must not be used, for example shell scripts around the linux inotify or watch commands. File-watching should use an event-trigger rather than polling if it is available. A file is considered stable if its size has not changed for n seconds. The figure for n can be a system-wide Oozie setting, rather than job-specific. For every matching file, run a Hive job h. The name of the matching file should be passed to the Hive job. The Hive job itself is not in scope - a dummy job is acceptable for testing purposes. Example: /tmp/[login to view URL] arrives, run Hive job h with /tmp/[login to view URL] passed to the job. /tmp/[login to view URL] arrives, run Hive job h with /tmp/[login to view URL] passed to the job. Multiple files can arrive at the same time. I don't mind if they are processed serially or concurrently. There is no requirement to process them in order. A failed job must not prevent further jobs from starting e.g. in the example above, [login to view URL] should be started even if 0001 did not process successfully. A failed job must be rerunnable, either from the command-line or Cloudera UI. Describe the steps. No formal documentation is required - a text file is acceptable. Please price these separately if it contributes more than 30% of the overall job cost. The file m should not be reprocessed if the timestamp or size changes. The file m should not be reprocessed if the Oozie job is restarted. The file m should not be reprocessed if the host is restarted.
ID проекту: 14113958

Про проект

3 пропозицій(-ї)
Дистанційний проект
Активність 7 yrs ago

Хочете заробити?

Переваги подання заявок на Freelancer

Вкажіть свій бюджет та терміни
Отримайте гроші за свою роботу
Опишіть свою пропозицію
Реєстрація та подання заявок у проекти є безкоштовними
Доручений:
Аватарка користувача
Hello, I have all the skills and experience that makes me a competitive candidate for this post. I have had an ideal prospect and am ready to accept any new challenges that may be put in front of me. If given an opportunity to work for your company I will fulfill the given work with utmost dedication and loyalty. My key skills: •Java,Hadoop,Big Data, Cassandra,Angular.JS •Hive,Map Reduce,Pig,HBase,Cloudera,Scala •HTML, CSS, HTML5, MySQL, NoSQL, MongoDB, AJAX •Client-side scripting, Server-Side Scripting •Spark,Kafka,Mule,JavaFX,JavaScript, jQuery, My Freelancer Profile: https://www.freelancer.in/u/punitpuneet2008.html I always give my 100% effort to do my job and client’s satisfaction is my first Skill When working on a new project, I like to speak with my clients so that I can have a clear understanding of their needs and vision of the project. What I Offer: - -100% Satisfaction - Free Support - Good Value for Your Money - Regular and Timely Updates -Strictly Adhering To Deadlines Thank you in advance for your time and consideration. I look forward to working with you soon.
£553 GBP за 10 дні(-в)
4,6 (1 відгук)
2,5
2,5
3 фрілансерів(-и) готові виконати цю роботу у середньому за £628 GBP
Аватарка користувача
I am a big data and machine learning developer in a private firm having good knowledge in big data tools and technologies including cloudera platform and all hadoop services.
£666 GBP за 10 дні(-в)
0,0 (0 відгуки(-ів))
0,0
0,0
Аватарка користувача
i am certified hadoop developer, having 3 + years of experience in hadoop and working for banking client, having sound knowledge in all hadoop components like pig, hive, mapreduce, oozie, sqoop and spark. if u r ok with my skills and for ur requirement let me know, shall we have a call to discuss further, my number +91-9502812708
£666 GBP за 8 дні(-в)
0,0 (1 відгук)
0,0
0,0

Про клієнта

Прапор UNITED KINGDOM
READING, United Kingdom
5,0
1
Спосіб оплати верифіковано
На сайті з трав. 23, 2017

Верифікація клієнта

Дякуємо! Ми надіслали на вашу електронну пошту посилання для отримання безкоштовного кредиту.
Під час надсилання електронного листа сталася помилка. Будь ласка, спробуйте ще раз.
Зареєстрованих користувачів Загальна кількість опублікованих робіт
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Завантажуємо для перегляду
Дозвіл на визначення геолокації надано.
Ваш сеанс входу закінчився, і сеанс було закрито. Будь ласка, увійдіть знову.