Published in The Startup·PinnedBetween Machine Learning PoC and ProductionThe Japanese version is here: (https://qiita.com/koyaaarr/items/259ad4f0d574497c5b08) Introduction Machine learning Proof of Concept (PoC) is very popular these days due to the recent AI boom. And afterward, if (very fortunately) you get good achievement in the PoC, you may want to put the PoC system into production. …Machine Learning17 min readMachine Learning17 min read
Nov 20, 2022Stone Soup and Data ScienceI've worked as a Data Scientist for several years and cooperated with non-technical people. Those experiences remind me that "Stone Soup," a folk story, has a profound insight into working as a Data Scientist. Let me share this story and my thought. For the sake of a delicious meal For those who don't know this story, here…Data Science3 min readData Science3 min read
Sep 19, 2022Stable Diffusion Quickstart with WSL2 and RTX3070~Generate Boss Baby-ish Profile Image ~ Objective To generate my profile image on Twitter. Unlike LinkedIn or Facebook, Twitter is a bit anonymous service, so I don’t want to use my photo as a profile image. Therefore, I’ve sought a nice picture to use my SNS icon. Pre-requisites Windows 10 Home 21H2 …Stable Diffusion3 min readStable Diffusion3 min read
Aug 28, 2022How to Deploy Your Jupyter Notebook As a Dashboard: A use case of visualizing stock data with AWS~ Build an automated dashboarding system with AWS SageMaker, GitHub Actions, ECR, App Runner, and Mercury ~ Introduction Jupyter Notebook is one of the vital tools for data scientists. However, there are still difficulties in collaborating with your teammates and sharing your notebooks with your stakeholders. I'll introduce an automated dashboarding…Data Visualization5 min readData Visualization5 min read
Jun 27, 2022Python Streamlit in Practice; A Use-Case of Visualizing Stock Data~How to create an ETF portfolio simulator in Python Streamlit~ Streamlit is becoming one of the great options for creating demos only using Python. I will explain how to create an effective dashboard using Streamlit and deploy Streamlit Cloud with actual stock data. Quick Demo Here is my demo of the ETF…Python6 min readPython6 min read
Published in CodeX·Jun 18, 2022Python Development Setup for Data Scientists in 2022There are a lot of useful tools and libraries appearing in recent years. Some don't seem to be famous among data scientists, while engineers often use them. Thus, I want to introduce some tools to data scientists new to Python or software development. In this article, I will show my…Python6 min readPython6 min read
Published in Dev Genius·Jun 2, 2022dbt and BigQuery in Practice; A Use-Case of Transforming Stock DataUpdated 2022/7/22: update data pipeline as follows; create an additional warehouse to store calculated portfolio value -> to isolate each data mart to avoid being affected by changes in each mart Updated 2022/6/11: pushed source code to GitHub: https://github.com/koyaaarr/invest-analytics-model Introduction This article explains how to use dbt and BigQuery to transform…Dbt6 min readDbt6 min read
May 25, 2022A Practical Use-Case of Cloud-Native and Secured Dashboard with Google Cloud and Python StreamlitIntroduction With rising cloud services and data scientist-friendly visualization tools, building a dashboard is getting easier and faster. However, it’s also becoming more and more complicated to understand or utilize them. This article will show the use-case of combining these technologies by building a secured dashboard managing my investment portfolio. This…Google Cloud Platform5 min readGoogle Cloud Platform5 min read
May 20, 2021I, as a data scientist, will show you why Jupyter Notebook and Jupyter Lab are good for data analysisFor those who want to get started with data analysis in Python This article will introduce Jupyter Notebook and Jupyter Lab (collectively called Jupyter), very reliable tools for data analysis in Python. Jupyter is already in common use in the data science world, but I would like to show its benefits with a demo. Assumptions In this article, I analyze data under the…Jupyter Notebook8 min readJupyter Notebook8 min read
