Burned Out Data Scientist – Switching to Back End SWE?

Question

I am a burned out data scientist in a data "head" role at a startup. At this point I have management experience and am at mid-career - I have been doing the data thing for a decade. I can't do it anymore, I can't stand cleaning or working with dirty data on a daily basis. I am sick of managing expectations about DS work with managers who just want models and results when they're not tenable.I have started to learn how to write back end code e.g. web services, APIs, working with Apache Kafka, and have found that working on these types of projects brings me joy. I am worried that companies will look at me as a very odd choice for hiring because of this career switch. Has anybody else gone from DS to more vanilla SWE? If so, what was your experience doing so? Any advice? Thanks.

burntoutfire · Accepted Answer

> I have started to learn how to write back end code e.g. web services, APIs, working with Apache Kafka, and have found that working on these types of projects brings me joy.Similar to data science, these things are fun when you play with them on your own. In a company setting however, it's often a shitshow not so different from your bad data situation. I'd be cautious about switching.

yamrzou · Answer

I did it two years ago after a couple of years of being a data scientist. I got tired of data cleaning, experimenting, tuning parameters, and managing unrealistic expectations about DS work. Data Science tasks seemed open-ended, I wanted something more deterministic, tasks that I could call finished at some point.
So I went from Data Scientist to Data Engineer which, in my current company, is a SWE working on data (as opposed to full stack or backend engineers). In my new role I worked closely with data scientists to ship their code to production, as well as data pipelines and some backend and infrastructure tasks. I'm enjoying it so far. It gets repetitive sometimes, but more bearable than DS work.
If you have enough SWE skills, as well as DS knownlegde, your profile could be attractive to some companies. You can also target ML Engineering or Data Engineering jobs. I think you don't have to worry much about switching. It's just a matter of finding the right company.
Good luck!

dyeje · Answer

Have you considered that maybe it's the head part of the role that's burning you out? I don't think you'd have much trouble switching, but I'd try out being an IC data scientist at somewhere with good work life balance first.

st1x7 · Answer

I'm in a similar situation but with less experience than you. After a couple of years of being a data scientist I'm realising that I enjoy building stuff a lot more than the other aspects of the job. So for my next job I'm looking for an ML engineer position - that way I can do more of the kind of work I like but it also means that I can leverage my existing knowledge and experience and I don't have to start from scratch.

methusala8 · Answer

I am also on the same boat, albeit at a lower designation. I totally agree with the bit about managers wanting results without having any clue on the feasibility of projects.Are there any IT careers which would be an easier transition apart from ML Engineer roles? Any thing based on Cybersecurity perhaps?

rajacombinator · Answer

It&rsquo;s a good move. SWE offers much better career prospects for very little effort. With a DS background you will have an edge also, provided you have the aptitude to do SWE. (A lot of &ldquo;DS&rdquo; don&rsquo;t.)

thedevindevops · Answer

Do you have any advice for people going in the other direction, wltrmcq?

probinso · Answer

be sure that it's a data science and not startups that you're burnt out on