TGTGInsighttelegram intelligenceLIVE / telegram public index
← python-telegram-bot

TGINSIGHT SIMILAR POSTS

Find similar content

Source channel @pythontelegrambotchannel · Post #75 · Oct 1

Fellow programmers. Happy #hacktoberfest. This event, hosted over here, is about giving back to open source projects. We encourage you all to check it out and make some contributions. We prepared some issues by ourself, they can be found here, but fear not to take on other issues in our repo. If you have any questions, feel free to ask them away in our chats, we are there to help!

Results

2 similar posts found

Search: #luigi

当前筛选 #luigi清除筛选
djangoproject

@djangoproject · Post #275 · 03/18/2017, 01:51 AM

https://github.com/spotify/luigi Writing batch jobs is generally only one part of processing heaps of data; you also have to string all the jobs together into something resembling a #workflow or a #pipeline. #Luigi, created by Spotify and named for the other plucky plumber made famous by Nintendo, was built to "address all the plumbing typically associated with long-running batch processes." With Luigi, a developer can take several different unrelated data processing tasks — "a Hive query, a Hadoop job in Java, a Spark job in Scala, dumping a table from a database" — and create a workflow that runs them, end to end. The entire description of a job and its dependencies are created as Python modules, not as XML config files or another data format, so it can be integrated into other Python-centric projects. #Machine_learning