Data Engineer

-Remote, contract role (East Coast preferred)

RedStream Technology is seeking a Data Engineer to join the team at a global management consulting firm.  The role will focus on data integration across varied data types and associated with a range of different industries and business areas.

You will be responsible for creating innovative solutions to enable seamless and secure data integration. Your solutions will be used to connect legacy, newly developed, and vendor applications across the data center and cloud environments, and you will be responsible for the full lifecycle of the solutions:

Job Requirements:

• Developing specifications, designing infrastructure and interfaces, developing code to enable data ingestion to the cloud
• Implementing the data integration platform and working with stakeholders
• Continuously improving the data integration platform
• Create and maintain optimal data pipeline architecture
• Assemble large, complex data sets that meet business requirements
• Identify, design, and implement internal process improvements, automate manual processes, optimize data delivery, and propose re-designing of infrastructure as appropriate to achieve scalability and cost reduction
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies
• Build and/or maintain analytics tools that utilize the data pipeline to provide actionable insights into operational efficiency and other key business performance metrics

Skills:    

• Proficient in building large-scale systems end to end using Java/Python/Golang (preferable Golang and Java) or other high-performance languages
• Experience with developer tools, CI/CD, DevOps, monitoring tools and engineering cloud migration solutions
• 8-10+ years of experience in modern technologies (e.g., Docker, Kubernetes, Java, Spring, Spring boot and RDBMS & No-SQL (e.g., PostgreSQL, Document DB, Opensearch) along with CICD tooling e.g., GitHub Enterprise, Jenkins, etc.
• Hands on experience working with REST API design and development using Spring boot and Spring framework
• Hands on experience working with GraphQL API design and implementation
• Work with API developers across the teams to build new API features at large scale
• Experience with cloud technologies such as AWS and AWS CLI including K8s, Lambda, API Gateway, IAM, NLB/ELB, Open Search, Document DB, EKS.
• Experience with Infrastructure as Code, preferably Terraform. Experience with Observability/Monitoring technologies: Splunk, ELK, Prometheus, CloudWatch, Grafana

• Education: Bachelor's degree in quantitative field like Computer Science, Engineering, Statistics, Mathematics, or related field required. Advanced degree is a strong plus