Web|Software|Desktop|Mobile developers. Find a remote job.

We are looking for a Data Engineer with 5+ years of experience, an outstanding fluency in English and a good team worker. Requirements: -Experience in designing data engineering solutions -Experience in large scale data processing (Apache Spark or similar) and Scala/Java -Expertise in SQL, (cloud-based data warehouses like Google BigQuery) -Familiar with stream and batch data processing patterns -Expertise in writing efficient, well-tested code with the focus on scalability and maintainability Nice to have: -Knowledge on job orchestrators (Apache Airflow…

Apache spark twitter streaming python

I need to build a recommendation system with apache spark using alternating least squares.

please see attache file for more info about the task.

Hi all, I have a Real-time stream processing project using Kafka and Spark I need someone who is good in Python, PySpark, Kafka and Jupyter Notebook I have done some of the work on this project (like 45%) and I need someone to finish it for me. NOTE: IT IS EXTREMLY IMPORTANT THAT YOU USE JUPYTER NOTEBOOK AND THE TEMPLATES PROVIDED ● Task 1 (Already Done): Kafka Producer - Producing the streaming data, where you can use csv modules to…

I am experienced SQL Datawarehouse expert. I want that someone will help me to set up an example flow like this - Source Files saved in a Datalake - Connect to a lake and read files via Databricks SQL/Python Notebook - Push the data into a SQL DB 100% of the time you will work with me on my Azure Subscription via Team Viewer to help me to understand this. Do not apply if you don't have real handson experience…

I need to install spark and pyspark to windows then run code

There will be a Jupyter Notebook attached. All the instructions are there. Please complete the cell blocks where it says [TODO] and inside the cell TO_BE_COMPLETED All the coding needs to be done using Python and apache spark. And the sample outputs are provided.

Candidates having the knowldege in Java Spring boot, Postman, Kafka and Mongodb is required. This is a long term project, only serious candidate should apply for it

Expertise in Java programming Expertise in Spark programming Expertise in Kafka Expertise in coding

Need a teacher for Big data analytics class on Masters level. Tutor should have idea about data visualizations, methodology, should be familiar with Hadoop spark.

I have a Hive script which is running out of memory and need someone who can tune it well

2 tasks 1. Analysis of temperature of cities using pyspark 2. ML algorithm implementation using pyspark

Ưu tiên các team đã có sẵn giải pháp có thể tái sử dụng lại nhanh

I have a project which involves connection from a up-steam systems to down stream sub-systems and we have to decommission some of the upsteam-systems and assign the related connections to the sub-systems to a nearby upstream system. I have the code for it and there was an issue with it.. Need to fix it.