For one of our client, a management consulting company, with Global Business Services Center located in Warsaw, we are looking for...

Data Architecture Engineer

...to join the Digital Software Solutions Department.

Company / team overview:

• Industry recognized strong brand with positive recognition from customers globally;
• Digital Software Solutions Department is newest departments with growth and agility of a start-up, with the backing of the top consulting firm. International team is responsible for development and support of digital solutions for internal consultants and external clients, to get better, faster insights and results;
• Digital Software Solutions Department manages software product development, ongoing support, customer success, technical services, and technical operations;
• The team supports practices, case teams, and clients through various product delivery models including best-in-class partnerships with leading SaaS vendors, product development using industry-leading low code and business engineering platforms, and developing highly complex custom software solutions and products.
• In addition to core product development, the team fills critical gaps through a growing technical services catalogue including technical architecture and code assessments, expert architecture consulting, business automation and integration, product visualization services, and infrastructure hosting and support.
• Benefits: Medical care (with dental and hospital package), Multisport card, Life insurance and attractive annual bonuses;
• Permanent employment contract (UoP only!)
• Covid time remotely, hybrid model after pandemic.

Key functions / responsibilities:

• Reporting Software Engineering Manager and support a market-leading customer experience benchmarking service.
• The primary tasks of this role revolve around core product development including working as part of a cross-functional Agile development team to understand the business context and product domain, designing the underlying data model/schema to meet the product’s functional and non-functional requirements, ensuring the data architecture scales and remains performant based on the expected volumes and usage patterns, is consistent and has the right enforcement and integrity checks, implementing the data model using scripts/automation, working with the team to test and validate the design, and updating the model as needed to support new and changing business requirements and product features.
• Another part of the role will revolve around managing operations, partnering with product teams and other data engineers to ensure the continuous delivery and quality of new releases. It will also involve the continuous improvement of all our working processes related to the ingestion, treating and consumption of proprietary survey data through automation and standardization.

Product Development, Support, and Maintenance

• Own the end-to-end data model /schema design, and support across its portfolio of products, including hands-on activities to deploy and maintain
• Oversee more junior data engineering colleagues during the implementation and maintenance of new products, acting as thought leader and helping to ensure processes consistency across different teams and products
• Work with Senior Architects and Engineering Managers to validate designs, discuss trade-offs and benefits of various approaches, and ensure long-term scalability and performance over time as data volumes and user concurrency grows with product adoption
• Ensure data models follow industry-standard best practices related to data security, normalization, naming conventions, primary/foreign key relationships, indexing, constraints, and other considerations
• Work with Cloud and Operations teams to ensure best practices and standards are followed related to infrastructure/hosting, data security, user access management, permissions, monitoring, patching, and logging/auditing
• Create approved and agreed-upon data models using DDL scripting to ensure repeatability and consistency, maintain scripts in a version control system
• After data model creation, work to validate/test the model to ensure it meets all product and business requirements including creating realistic sample data sets, ensuring product queries and DDL statements run within expected values, run explain plans to ensure queries follow optional execution paths, and data remains consistent over time
• Collaborate with Product Visualization Engineering team on defining the optimal data structures for BI tools to leverage the data, which could include custom views, materialized views, user defined functions/procedures, or optimized SQL
• During the course of product development, work as part of the core engineering team to update and test the data schema as needed to support new requirements and updates
• For leave-behind SaaS products requiring automated data ingestion, work to design and implement data pipelines that take data in from a variety of sources (cloud storage, flat files, APIs, etc.), run various cleansing/validation processes, and output the data in a defined format for product usage

Product Deployment

• Work as part of a cross-functional team to successfully deploy its products to new industries and clients;
• Define, document, and communicate required data schemas formats for products and collection requirements for case teams/clients;
• Work with clients on defining the expected data set sizes, including initial load, cadence of new data imports, and long-term sizing of data based on usage assumptions;
• Work to procure required data from client systems using a variety of protocols including APIs, direct database connections, SFTP, cloud, flat files, and others;
• Use industry-leading data/ETL tools for data preparation including data validation, cleansing, joins/mergers, and reformatting into product required schemas for import;
• Upload data into product databases, ensuring data accuracy, consistency, and integrity;
• Provide 3rd level technical support as needed when issues arise;
• Keep up-to-date on various technologies related to data architecture and engineering;
• Participate on technical discovery, POCs, and innovation work streams to validate new tools, technologies, and designs;

Requirements:

• Bachelor of Science degree in Computer Science, Applied Mathematics, Engineering, or any other technology-related field preferred, or strong relevant work experience;
• Total of 5+ years of relevant work experience with a data-engineering focus in a fast-paced, complex business setting;
• Strong experience with traditional relational database management systems (e.g., PostgreSQL, SQL Server, MySQL, Oracle) and SQL skills (DML & DDL);
• Strong relational data modelling and design skills (tables, relationships, PK/FK, constraints/indexes);
• Strong experience creating custom user defined functions, procedures, views, materialized views, and optimized SQL;
• Ability to troubleshoot slow performing queries, examining indexes, and running explain plans;
• Experience designing, implementing, and supporting end-to-end automated data pipelines using enterprise tooling, cloud-native services, or custom coding/development;
• Experience working with version control systems (e.g., Git);
• Strong experience working with the end-to-end integration of data preparation, database management and visualization tools (Alteryx, PostgreSQL and Tableau - nice to have;
• Fluent English