Decoding the Consultant Life: Real stories from real consultants
Muhammad Faiz Wahjoe, Data Engineer, about working for our customer Plugit
I am Perttu Pakkanen and my interest as Codento’s talent acquisition lead is to better articulate why consulting could be a great career choice.
When potential customers ponder whether they should use our services, they usually like to see some reference cases. Why wouldn’t our potential employees think the same?
So, I did an email interview with our data engineer, Faiz.
Faiz has been working with the Codento team to gather the different use cases of data and ultimately establish a robust data warehouse to centralize Plugit’s data management and enhance its organization.
In customer’s own words, it has been “the best-run consulting project we’ve experienced”.
I asked Faiz some questions about the project and to my delight, he gave very comprehensible answers.
Read more below:
What kind of solution have you built?
In brief, we did modernization of the client’s data platform. The client operates numerous charging points for electric vehicles and as such, they handle a lot of data.
The motivation for this project was while the client’s previous data platform was already established and fulfilled the day-to-day requirements, Performance and scalability issues started to be detected. Hence, modernization was deemed necessary.
The modernization was about creating a GCP-focused BigQuery-based data platform and its related tools, for example, Dataform for data transformation purposes. We then created a pipeline to connect customer’s data sources to BigQuery in which we use Dataflow and then we leverage Terraform as our IaC tool to set up and manage our system’s infrastructure on GCP.
What kind of tasks have you done in the project?
I spend most of my development time in Developing data pipeline using Dataflow and setting up transformation script using Dataform.
What has been the most interesting thing you have done working for the customer?
We held a workshop together with the client and we identified one particularly interesting insight that we are keen to know. This insight is about automatic problem detection of the client’s many charge points by looking at the pattern of one of the particular kinds of data they produce.
This sounds quite simple but to realize that such an important insight could be derived from such simple data, with the right transformation, is intriguing – in my culture we have a saying “We could see ants across the sea but missed an elephant in our face”.
Even more interesting, while deriving this insight from a limited size of dataset could be said as simple, Deriving it from millions of data record, every day, across tens of thousands of data producer points bring another dimension of challenge and here, the strenghts of tools that we are leveraging shine. The powerful data processing capability provided by BQ and Dataform made this operation reliable both in performance and accuracy and easy to develop and manage.
What brings enthusiasm to your workdays?
I always like if my work produces real impact(s) in solving a problem for our clients and users and in this project those impacts are plentiful to see. I also put a positive and productive work atmosphere as one of the main factors and it is quite visible in this project as well, working with my fellow codento consultant and the periodic, routine discussion with the client has been quite a positive experience.
On top of that, I got to work on many modern innovative tools in solving the client’s problem, while I always think of a tool as a means to solve the Client’s problem e.g. we should not pick a tool based on “hype” or “that’s what everyone is doing” alone but rather the suitability.
What has been the most difficult part?
I think the most challenging part for us is understanding and navigating Dataflow traits, quirks, and limitations.
Especially the Python SDK library that we are using. It’s a relatively new tool and its rather specific use case means community support is not as plentiful as we want it to be. This also has a consequence that LLM tools quite often fails to give consistent and accurate help. I also do not have extensive experience in production-grade Dataflow so the learning curve was quite steep.
But, we worked together, leveraging our experience so we could learn and understand the tools better faster, and in the end, we were able to deliver the project in a state that the client was really satisfied. So, the client’s satisfaction and my own skillset growth have been more than rewarding.
What have you learned?
I learned a lot.
From the technical perspective, I gained important knowledge and experience and got to improve my skillset in the various tools that we are using: Dataflow, Dataform, BigQuery, and so on.
From a non-technical perspective, I also gained experience in how a consultancy project is run and managed, how to identify important milestones and navigate challenges, and how to deliver a solution that solves the problem and produces a positive impact on the client’s case.
I also met and worked with new people, understanding not only their needs and requirements but also how to effectively communicate and cooperate in teamwork. As such, interacting and working together with them and fellow Codento consultants has been quite a pleasant and fruitful learning opportunity and experience.
Thank you Faiz for the awesome and comprehensive answers!
—
Being part of pioneering projects like this allows for both personal and professional development. I strongly feel that at Codento you can engage in work that is not only challenging but also highly impactful in many industries.
Read more about us from our career site and see if there are any suitable opportunities for you and connect with us on our recruitment system!
About the interviewee:
Faiz is a talented data engineer with a computer science degree from Aalto University.
About the interviewer:
Perttu Pakkanen is responsible for talent acquisition at Codento. Perttu wants to make sure that the employees enjoy themselves at Codento because it makes his job much easier.
