My Predictions for Data Engineering in 2024
Here's What I'm Focusing on (and You Should Too)
My prediction for 2024 and data engineering is this…
Who cares! Seriously.
You can’t control what happens, so instead of worrying about what will happen, focus on the things you can control. Like…
1. Building a Learning Habit.
This year, make learning a priority. Try your hardest to establish a solid learning habit. If you don’t have time for it, MAKE TIME! No one else is going to do this for you.
Remember, even 20 minutes a week is better than nothing.
Find something you want to excel in. I recommend the fundamentals (SQL, Python, Data Modeling).
It’s all about the mindset; continuous learning is where it’s at.
2. Working on Your Soft Skills.
If you want to get ahead of the pack, it’s time to learn to play nicely and get good at soft skills.
You have no option now; you cannot wing it. With AI here for good, every Tom, Dick, and Harry will be able to “code.” The thing that will set you apart from everyone else is soft skills.
It’s time to get good at communication, teamwork, collaboration, problem-solving, and time management. These are good places to start.
3. Building Out Projects That Will Help You Grow.
I’m going to be honest with you. Nobody cares one bit about your side project (unless you somehow invent a revenue multiplier that Google and Apple snap up), but you can leverage it as a powerful tool to challenge your current skill set.
You should be the only one who cares about what you build.
I use side projects as a way to push myself to learn new aspects of data engineering (that I might not be exposed to at work).
It’s also proof to yourself and everyone else out there that you are dedicated to self-education.
4. Lifting Up and Helping Others.
The best way I’ve found to learn something fast is to teach someone else. The more you give, the more you get back. Trust me on this one. When I stopped focusing on myself and started focusing on those around me, lifting them up and helping others, I started leveling up too.
If there are juniors on your team, work with them, bring them along for the ride, and share your knowledge and experience. Better yet, get involved with the data community, make friends, and share what you know.
It will make you a happier data engineer.
5. Time with Family.
Family first.
You hear this all the time in self-help books, advice blogs, or from any 'Top Voice' out there, but 90% of them don’t follow through with it. For every post that says 'family first,' there is probably a post saying 'I neglected my family so I could focus on “X.”'
Be better than that. Your project, company, business idea, whatever it may be, should be secondary. This year, put those you love first.
Make balancing your work and personal life the number one priority. If you want to be a rock star data engineer, you need to get this right from the get-go. Your family is the foundation your career is built on.
Keep it strong.
6. Your Health and Well-being
This is something that I’ve let slip. I’m including it here to remind myself how important this is, and for you too.
Look, I get it. You are one person, with 24 hours in a day and only two hands (God was stingy in that respect). If you have kids, you’re on the back foot from the get-go, but — and this is a big but — you've got to find time for exercise and a good-ish diet. No excuses.
I’m going to try hard to get this right. I hope you can too.
There you have it.
These things pay dividends in the long run. Putting in time and effort in the areas mentioned above will, ultimately, be hugely beneficial for you.
These are the things you should be focusing on.
Not what new shiny thing is going to happen in data engineering, or chasing the latest trends and technologies that may quickly become obsolete.
You and I are not mind readers. Whatever’s going to happen will happen. You don’t have a say.
The people out there 'predicting' what will happen don't have a clue (they are guessing), just like you and me.
Prepare for the worst, hope for the best.
Thanks for reading! I send this email out weekly. If you would like to receive it, join your fellow data peeps and subscribe below to get my latest articles.
👉 If you enjoy reading this post, feel free to share it! Or feel free to click the ❤️ button on this post so more people can discover it on Substack 🙏
🚀 Want to get in touch? feel free to find me on LinkedIn.
🎯 Want to read more of my articles, find me on Medium.
✍🏼 Write Content for Art of Data Engineering Publication.