Don’t sweat it. Taking a Smalltalk role will not impede your career development. In fact, you can change languages and stacks with every job and it still won’t really affect much.
At the software consultancy I work for, we’re expected to be polyglots. Reason is, the company cannot always find a project for you with your expected tech stack.