No Module Named 'pyspark.streaming.kafka' Even With Older Spark Version

In another similar question, they hint 'install older spark 2.4.5.' EDIT: the solution from above link says 'install spark 2.4.5 and it does have kafkautils. But the problem is I c

Solution 1:

i just downgraded it using pip:

pip install --force-reinstall pyspark==2.4.6

I did not use any poetry. AFter reinstalling, the kafkaUtils pkg was recognized.