Hi 👋 I’ve been experiencing

pylint

crash whenever I import

janitor

in a metaflow. A minimum example is shown below:

import janitor
from metaflow import FlowSpec, step

class LinearFlow(FlowSpec):

    @step
    def start(self):
        self.my_var = 'hello world'
        self.next(self.a)

    @step
    def a(self):
        print('the data artifact is: %s' % self.my_var)
        self.next(self.end)

    @step
    def end(self):
        print('the data artifact is still: %s' % self.my_var)

if __name__ == '__main__':
    LinearFlow()

… and I will get the error:

Metaflow 2.7.18 executing LinearFlow for user:jixux
Validating your flow...
    The graph looks good!
Running pylint...
    linear_flow.py:1:0: F0002: /local/home/jixux/test/metaflow/linear_flow.py: Fatal error while checking '/local/home/jixux/test/metaflow/linear_flow.py'. Please open an issue in our bug tracker so we address this. There is a pre-filled template that you can use in '/local/home/jixux/.cache/pylint/pylint-crash-2023-04-18-16-46-18.txt'. (astroid-error)
    Pylint is not happy:
    Fix Pylint warnings listed above or say --no-pylint.

Apparently I can use --no-pylint to override this crash but I really miss the pylint capability. Any suggestions would be helpful~ (I also reported this as a bug in the pylint community)