Dallas client is looking for a Data Engineering Manager to join their elite agile Data Engineering team responsible for developing and maintaining our industry-leading cloud-based OLTP, Data Warehousing big data and data analytics infrastructure serving major global fortune 500 companies.
The candidate will help in leading a group of data engineers to assist in Architecting, Designing and Developing end to end data engineering solutions. Data performance testing, deployment, troubleshooting, defect resolution, and support of our data services infrastructure.
Responsibilities & Tasks
- Utilize architectural and design skills for a variety of data-oriented tasks
- Understanding of OLTP databases and Infrastructure required to support applications with 500 TPS
- Establish and maintain strong relationships with business stakeholders
- Build high reliability systems that provide complete, secure, accurate and timely data for analytics, data modeling, new product features and services – including financial reporting
- Assist development and analytics organization to meet its delivery goals about data deign, flow and infrastructure
- Perform Data Modeling, Architecture design and implementation to support OLTP and Warehousing applications; assist features in Data flow design and Data
- Mentor team members and enable them to work independently with cross functional LOB leaders.
- Work with business users to understand business requirements, issues, and business and/or client processes
- Hands on coding of data pipelines
- Hands on administration of existing databases and big data systems
- Develop, test, and maintain high-performance of our data systems to meet the requirements of the business and/clients while adhering to departmental standards
- Perform quality assurance testing for all work performed
- Prepare required documentation as outlined by departmental standards
- Meet with agile teams as required to define and document application requirements
- Follow project development & deployment process
- Maintain industry standards and best practices
- Maintain security and organization of the company’s data
- Provide off-hour support as assigned
- Provide high level estimates for new business requirements/features
- Work with manager to ascertain the company’s data requirements
- Install new databases, data pipelines, maintain existing databases and data pipelines
- Design and implement processes and solutions for data distribution and data archiving
- Develop and implement backup and recovery plans to mitigate the possibility of data loss
- Monitor storage space, storage capacity, and system performance
- Identify, analyze, and repair data problems as needed
- Provide recommendations for application and system improvements
- Plan work to meet project deadlines, accommodate demands by development teams, set priorities, and escalate issues appropriately
- Provide recommendations to development teams for data restructuring and performing complex maintenance
- Deploy and manage changes in development, staging and production
- Assist development and dev ops teams on SQL queries and tuning
Technical Skills and Experience
- Strong management skills with at least 4 years of experience building, managing, and maintaining a team of Data Engineers / DBAs
- At least 10 years of experience in basic-level administration of both data infrastructure and data
- At least 7 years coding experience in Python or other equivalent programming language
- At least 4 years big data and data architecture experience
- Proficient in a variety of big-data tools and technologies, including Hadoop, Spark, etc.
- Proficient in SQL and PL-SQL, query tuning, optimization, ETL, ELT, and Data Warehousing
- Experience in custom archive and purge procedures and scripts
- Proficient in Business Intelligence (BI), analytic database and products, able to take business requirements and translate into database and pipeline design and tasks
- General data-specific concepts, frameworks, and processes
- Agile development practices
- Working within an SDLC
- Designing data warehouses including definition, structure, documentation, maintenance, long-range requirements, operational guidelines, and protection
- Linux operating systems
- Data integration and processing including extraction, transformation, and loading (ETL), data analysis, and metadata
Other Skills and Experience
- Cloud experience, such as AWS, GCP or Azure
- Excellent oral and written communication
- Multi-tasking and managing multiple priorities
- Working well in a team-oriented, collaborative environment with people from different disciplines and varying degrees of technical experience
- Working in an Agile team environment
Education
- Bachelors, Masters, or equivalent experience
About The InSource Group: When you are looking for a new career opportunity, you need an advocate with strong connections within the best companies. The InSource Group supplies select information technology specialists like you, to some of the nation's most prominent companies, ranging from start-ups to Fortune 500. The InSource Group's proven recruiting process ensures you are well matched with potential employers. We will assist you with your resume and interviewing techniques as well as provide you background information on the companies and people you choose to interview with. Our account managers and recruiters have a depth of industry experience that enables us to place you in the optimal setting for your skill set, culture preference and job requirements. We match candidates and clients so successfully our client satisfaction on placements is greater than 99 percent.
