TensorFlow Core APIs: Building Machine Learning Models from Linear Regression to Digit Recognition

This tutorial, led by Sherry Moore from the Google Brain team, provides a foundational understanding of TensorFlow, Google's open-source machine learning library. It begins by introducing TensorFlow's core design principles, emphasizing its flexibility, modularity, and suitability for transitioning machine learning research into production. Key components like tensors (multi-dimensional arrays), computation graphs, and variables (for weights and biases) are explained as the building blocks of neural networks, illustrating how data "flows" through these interconnected nodes.

The session highlights TensorFlow's widespread adoption, evidenced by its popularity on GitHub, and its extensive use within Google for diverse applications such as image recognition (Inception), voice search, Smart Reply, game development, and artistic generation (Deep Dream). Moore underscores the platform's portability, demonstrating its ability to run across various devices from laptops and data centers to mobile phones and specialized hardware like TPUs, and encourages community contributions to its open-source ecosystem, including the development of new models and higher-level APIs like Keras and TF Learn.

The practical segment of the tutorial guides participants through building two classic machine learning models: linear regression and MNIST digit classification. For linear regression, the objective is to guess a mystery linear function's weight and bias from sample data. The MNIST lab introduces more advanced concepts crucial for real-world applications, such as placeholders for dynamic data feeding, checkpoints for saving and loading model states, and evaluation metrics to assess model performance, alongside the use of a global step to track training progress.

Throughout the tutorial, Moore stresses the importance of understanding the underlying core TensorFlow APIs, even when higher-level abstractions are available, likening it to having the raw ingredients to cook any meal. She also emphasizes the value of visualization tools like TensorBoard for debugging and validating network architectures, and encourages experimentation with different loss functions and optimizers (e.g., Gradient Descent, Adam) to deepen understanding and foster innovation within the machine learning community.

"TensorFlow is a machine learning library that we developed uh at Google and we open sourced it last November and ever since then we have become the most most popular machine learning library on GitHub."

"Basically if your model can be asynchronous and fire on when data is ready you can probably use tensor flow."

"We don't want to want you to write all the code that's typically you know just throwing away we want you to write code that can literally cut and paste and saving the file and and prze it immediately."

"In tensor flow all the data is held in something called a tensor tensor is nothing more than a multi-dimensional array for those of you who are familiar with numpy arrays it's very similar to the ND array."

"Sir Arthur Clark that says any sufficiently what's the word any sufficiently advanced technology is indistinguishable from Magic."

"Can you imagine you can just write your own tensorflow application it could be your security system because you know somebody just stole my bike and my security camera capture all this grainy stuff that I cannot tell wouldn't it be nice if you do machine learning on this thing and it just start taking high resolution pictures."

"Based on the statistics that we collected in February over 10% of the all the responses sent on mobile is actually done by our smart reply."

"Whenever you build any model there are I would say four things that you will need you need input you need data you're going to be build building an inference graph... and then you will basically run the graph."