Aquasight LLC has an opening for the position of Sr. Software Engineer (Data Pipeline) (Ref# SSE327AB).

Work Location: 1650 W. Big Beaver Rd., Suite 101, Troy, MI 48084. Position may telecommute/work remotely with 1 day a month in the office.

Job Duties: Responsible for extracting live stream of real-time SCADA data from client systems using Python and Boto3 and streaming the data to Aquasight MySQL clusters. Develop and maintain the data pipeline from the client system to real-time analytics in the app dashboard. Build the data pipeline for the flow of live raw data to analytics and analyze data to the web application. Deploy real-time analytics using Python, AWS Lambda, AWS API Gateway, and Postman. Responsible for creating/managing MySQL cluster databases and tables for the analytics to run efficiently. Design and develop data systems to collect data from diverse sources such as APIs, databases, files, and streaming platforms. Design a system for the live streaming of data using Python scripts. Design algorithms and data structures for the efficiency in retrieval and storage of data. Build complex SQL queries for fetching real-time data efficiently. Develop Rest APIs using Python and AWS API Gateway / Lambda functions. Develop and integrate AWS Lambda functions for user defined analytics. Deploy analytics for raw data. Automate manual analytics using AWS Lambda and S3 triggers to decrease manual intervention. Collaborate with data scientists and analysts to understand data requirements and design strategies that meet their needs. Implement algorithms and protocols for efficient and reliable data extraction, transformation, and loading (ETL) processes. Build tools and scripts for scheduling, monitoring, and managing data jobs. Troubleshoot issues and perform quality checks related to data system, data sources, and data pipelines and provide timely resolutions. Work closely with software engineers and customers to integrate data systems with existing infrastructure and applications. Collaborate with cross-functional teams to define requirements, prioritize tasks, and drive projects to completion. Identify design patterns for the reusability of the solutions to the commonly occurring software design issues. Use of Python, Java, MySQL, PostgreSQL, Rest API, Shell Script, AWS (Lambda, S3, API Gateway, SimpleDB, IAM, EC2, SES), JIRA, Anaconda, Jupyter Notebook, Visual Studio Code, AWS SDK for Python (Boto3), Postman, Sequel Pro, TablePlus, DreamFactory API, and MS Excel.

Requirements: This position requires a Master’s degree or foreign academic equivalent in Computer Science, Data Analytics, Computer Engineering, or a related field. Plus 2 years of experience in the job offered or a related occupation. 40hrs/week.

Application Instructions: To apply, please MAIL resume to the following address, ensuring to indicate the position reference code (Ref# SSE327AB) for which you are applying. Mail to: Aquasight LLC, Rupali Lunani, Chief Operating Officer, 1650 W. Big Beaver Rd., Suite 101, Troy, MI 48084.