What does HackerNews think of sparkmagic?
Jupyter magics and kernels for working with remote Spark clusters
Sparkmagic (https://github.com/jupyter-incubator/sparkmagic)
Sparkmagic provides jupyter magics and kernels for working with remote Spark clusters. It's used by thousands of developers and companies like Pinterest, Amazon, more!
I've been maintaining for the past few years and would love help!
KSOPS (https://github.com/viaduct-ai/kustomize-sops)
KSOPS, or kustomize-SOPS, is a kustomize KRM exec plugin for SOPS encrypted resources. KSOPS can be used to decrypt any Kubernetes resource, but is most commonly used to decrypt encrypted Kubernetes Secrets and ConfigMaps. As a kustomize plugin, KSOPS allows you to manage, build, and apply encrypted manifests the same way you manage the rest of your Kubernetes manifests.
KSOPS is the most popular kustomize plugin and I'd love help maintaining and improving it from out GitOps fanatics.
My notebook code typically involves a data prep stage with querying a SQL database, then downloading into Python for more complex analysis, ML modelling, integration with external data sources, etc. So the notebook has a Python kernel with SQL usually as embedded """-quoted strings.
Does anyone have a solution to treating selected code cells as SQL - with SQL highlighting and tooltips - exposed as string variables to the Python code?
Sparkmagic [1] does part of this for Python/SQL/Spark interoperability, but as far as I recall, doesn't support SQL syntax highlighting.
At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, smarter, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us!
To get a sense of our engineering culture, check out the open-source projects we've created or maintain:
- https://github.com/viaduct-ai/kustomize-sops
- https://github.com/viaduct-ai/hybridcontents
- https://github.com/jupyter-incubator/sparkmagic
- https://github.com/shreyashankar/gpt3-sandbox
- https://github.com/viaduct-ai/pipelines
Reach out at [email protected]
At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, smarter, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us!
To get a sense of our engineering culture, check out the open-source projects we've created or maintain:
- https://github.com/viaduct-ai/kustomize-sops
- https://github.com/viaduct-ai/hybridcontents
- https://github.com/jupyter-incubator/sparkmagic
- https://github.com/shreyashankar/gpt3-sandbox
- https://github.com/viaduct-ai/pipelines
Reach out at [email protected]
At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, smarter, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us!
To get a sense of our engineering culture, check out the open-source projects we've created or maintain:
- https://github.com/viaduct-ai/kustomize-sops
- https://github.com/viaduct-ai/hybridcontents
- https://github.com/jupyter-incubator/sparkmagic
- https://github.com/shreyashankar/gpt3-sandbox
- https://github.com/viaduct-ai/pipelines
Reach out at [email protected]
At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, more intelligent, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us!
To get a sense of our engineering culture, check out the open-source projects, we've created or maintain:
- https://github.com/viaduct-ai/kustomize-sops
- https://github.com/viaduct-ai/hybridcontents
- https://github.com/jupyter-incubator/sparkmagic
- https://github.com/viaduct-ai/pipelines
Reach out at [email protected]
At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, more intelligent, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us!
To get a sense of our engineering culture, check out the open-source projects, we've created or maintain:
- https://github.com/viaduct-ai/kustomize-sops
- https://github.com/viaduct-ai/hybridcontents
- https://github.com/jupyter-incubator/sparkmagic
- https://github.com/viaduct-ai/pipelines
Reach out at [email protected]
At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, more intelligent, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us!
To get a sense of our engineering culture, check out the open-source projects, we've created or maintain:
- https://github.com/viaduct-ai/kustomize-sops
- https://github.com/viaduct-ai/hybridcontents
- https://github.com/jupyter-incubator/sparkmagic
Reach out at [email protected]
At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, more intelligent, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us!
To get a sense of our engineering culture, check out the open-source projects, we've created or maintain:
- https://github.com/viaduct-ai/kustomize-sops
- https://github.com/viaduct-ai/hybridcontents
- https://github.com/jupyter-incubator/sparkmagic
Reach out at [email protected]