360|iDev 2017

360|iDev Schedule

Sunday (August 13)

Workshop 1: BUILD YOUR OWN CUSTOM MUSICAL INSTRUMENT

• Link: https://360idev.com/sessions/build-custom-musical-instrument/
• Presenter: Aurelius Prochazka
• Folder: 01_BuildYourOwnCustomMusicalInstrument
• Xcode8

In this workshop we utilized AudioKit to build some custom soundboards. We learned about some of the features of the audio support for iOS.

Workshop 2: DEVELOPING FOR APPLE WATCH WITH SWIFT

• Link: https://360idev.com/sessions/developing-apple-watch-swift/
• Slides: https://speakerdeck.com/slaunchaman/do-i-need-an-apple-watch-app-360-idev-2017
• Sample Code: https://github.com/SlaunchaMan/Timeato
• Presenter: Jeff Kelley
• Folder: 02_WatchOS
• Xcode9

We built a watch app from scratch (a pomodoro timer):

• IB for Watch apps (the only way to build them, no code only VCs)
• Wired up the app itself with a "settings" menu (to configure the length of time)
• Wired up notifications (using UNNotificationCenter)
• Created a complication (Extra large only due to time constraints)
• moved the supported watch version back to add support for older WatchOS versions

XCODE AND FRIENDS

• Presenter: Kendall Gelner
• Materials: https://www.dropbox.com/sh/pyc4uz4ad1aji2f/AAAm9bQ5jXisq4DP5W1tDYjSa?dl=0

Monday (August 14)

HealthKit

• Presenter: Igor Kantor
• Folder: 03_HealthKit
• https://github.com/Iiiggs/AsthmaBuddy - reference app
• https://github.com/ResearchKit/ResearchKit - ResearchKit
• HKUnit - really useful for unit conversions
• HKWorkout - for reporting workouts
• HKQuery Types:
  • HKAnchoredObjectQuery
  • HKCorrelationQuery
  • HKObserverQuery
  • HKSampleQuery
  • HKSourceQuery
  • HKStatisticsQuery
  • HKStatisticsCollectionQuery
• ResearchKit Chart Control: ORKLineGraphChartView

BEYOND BYTE: PROTOTYPING WITH IPAD PLAYGROUNDS

• Presenter: Steven Lipton
• Page: http://makeapppie.com/swift-playgrounds/
  • Full Download
  • MakeAppPie Starter Book
  • Prototype Starter

EXPLORING NEURAL NETWORKS FOR RECOGNITION OF HAND-DRAWN SHAPES

• Presenter: Chris Parrish
• Folder: 04_NeuralNetworks
• Code
  • https://github.com/twenty3/Synapse.git
  • https://github.com/collinhundley/Swift-AI
• Slides: https://www.dropbox.com/s/qhggbpg2z5f4i5c/Exploring%20Neural%20Networks%20v2.pdf?dl=0

Chris presented "Napkin Demo", gesture-based demo on the mac that recognizes a few "shapes"

• Neuron

  • a node that sums incoming signals and outputs a signal
  • activation function controls output based on the inputs

• Synapse

  • Connections between neurons
  • Synapse scales or weights the input traveling along it

• Sigmoid function is useful for "bucketing" outputs

• Feed Forward Network - no feedback

• Simple model: inputs, 1 hidden layer, outputs

• Back propagation and gradient descent

• Youtube has videos on Gradient Descent and Back Propagation

• http://playground.tensorflow.org

• Book: Make your own Neural Network (Rashid, Tariq)

• Capturing the drawing

  • UIPanGestureRecognizer
  • Connect the points in a quadratic BezierPath (normalizing the input)

• WWDC 2012 Session: Building Advanced Gesture Recognizers

• Strategy

  • Capture drawing as an image (crop to just the path bounds, normalize the aspect)
  • Scale the image down (just enough pixels to capture the essential features, restroke the path so stroke width is invariant)
  • Convert to Grayscale (RGB would me we'd need 3 input nodes for each pixel)
  • Network expect inputs between (0.0, 1.0) - clamping

DYNAMIC TYPOGRAPHY & ADAPTIVE LAYOUTS IN IOS 11

• Presenter: Sean Coleman
• Slides: https://speakerdeck.com/bjtitus/creating-adaptable-layouts
• Font Pairing:
  • Roboto Slab / San Francisco Pro Text (example)
• San Francisco was designed with Accessibility in mind.
  • Best font to use with dynamic typing
• IOS6: Auto Layout
• IOS7: Dynamic Type
• IOS8: Adaptive Layout
• IOS9: San Francisco font / UIStackView
• IOS10: Automatically Adjust Font / preferredContentSizeCategory
• IOS11: Dynamic Type for custom fonts / Adaptive Layout is ready
• Accessibility Inspector (Xcode9) tool can interact with the simulator (change text size)!
• Common issue: Style Guides != Text Styles
  1. Persuade your stakeholders
  2. Scale (scale the font size based on system scale)
  3. Lookup table
• Adaptive Layouts
  • Show the NYT paper embedded in a iOS Screen
• Be a platform advocate!

EVENT DELIVERY IN IOS

• Presenter: Brandon Alexander
• Slides: https://github.com/whilethis/360iDev_Event_Delivery

ADVANCED DEBUGGING WITH XCODE EXTENDING LLDB

• Slides: https://www.slideshare.net/aijazansari2/360idev
• Code: https://github.com/aijaz/lldbPythonScripts

ADVANCED DATES AND TIMES IN SWIFT

• Presenter: Jeff Kelley
• Slides: https://speakerdeck.com/slaunchaman/advanced-dates-and-times-in-swift-360-idev-2017
• Playground: https://360idev-2017.slack.com/archives/C6NHX9DT6/p1502833781000368
• Project (Drop it like its clock): https://github.com/SlaunchaMan/DropItLikeItsClock

ADVANCED BUILDING APPS FOR APPLE TV

• Slides: https://github.com/justindomnitz/iDev2017_tvOS
• Sample Code: https://github.com/justindomnitz/iDev2016_tvOS

FROM IOS TO IOT: THE EXPERIENCES OF A SOFTWARE GUY BUILDING HARDWARE

• Presenter: Ben Lachman
• Slides: http://meetglow.com/docs/2017-360-talk.pdf

Tuesday (August 15)

PRACTICAL SECURITY

• Presenter: Rob Napier
• Slides: https://github.com/rnapier/practical-security

LEARNING FROM IOS ANIMATIONS

• Presenter: Justin Miller
• Slides: http://justinmiller.io/talks/media/Justin%20Miller%20-%20360iDev%202017%20-%20Learning%20From%20iOS%20Animations.pdf

PLAYING NICE WITH DESIGN

• Presenter: Ellen Shapiro
• Slides: https://speakerdeck.com/designatednerd/playing-nice-with-design-360idev-denver-august-2017
• Some talking points:
  • TrueColors (Open Source: TBD)
  • Sourcery: https://github.com/krzysztofzablocki/Sourcery
  • "Uniform" (Interactive Style Guide):
  • Using playgrounds to work with your designers
  • Playgroundbook - Ruby framework for building playground books:
    • https://github.com/playgroundbooks/playgroundbook
  • For now, have your designers run Xcode to run your playground (from your workspace)
    • Add a run script to launch the playground (see slides)

CREATING ADAPTABLE LAYOUTS USING TRAIT COLLECTIONS AND CONTAINER VIEWS

• Presenter: Brandon Titus
• Slides: https://speakerdeck.com/bjtitus/creating-adaptable-layouts

DEEP LEARNING ON IOS

• Presenter: Shuichi Tsutsumi
• Slides: https://www.slideshare.net/t26v0748/deep-learning-on-ios
• Sample Code: https://github.com/shu223/iOS-10-Sampler
• Github: https://github.com/shu223 (iOS Samplers)
• How to implement "Deep Learning" on iOS
• "Pose Estimation" example
• Demo - app that recognizes over 1000 types of objects (while in airplane mode)
  • Pre-trained models (inference) take considerably less CPU and can run on a mobile device
• CoreML (iOS11)
  • Uses Metal Performance Shaders (MPSCNN) - GPU - iOS10
  • Uses Accelerate (BNNS) - CPU - iOS10
• 3 steps
  1. Create the Model
     • What tools can be used for the training?
       • TensorFlow
       • Caffe
       • Keras
       • Any other format can be used as long as it can be read by the app: .dat, .hdf5
  2. Implementing the Network
     • Classes corresponding to each CNN layers are provided:
       • MPSCNNConvolution (Convolution)
       • MPSSCNNPooling (Pooling)
       • MPSCNNFullyConnected (Fully Connected)
     • Complicated math or GPU optimization are encapsulated
  3. Implement the inference
     • MPSImage: Input Image
     • CNN: trained params are loaded
     • Result
• Demo: Swift Logo detection
  • Trained the model using Tensor Flow
  • 2000 lines of code for the shader implementation
  • CoreML:
    1. Convert w/ coremltools
    2. Drag & Drop model -> xcode -> generate Swift
• Vision framework sits on top of CoreML
  • You don't have to touch metal to use the vision framework
• You should generally choose MPSCNN (GPU) over BNNS (CPU) for ML

TensorFlow on iOS

• Presenter: Taylan Pince @tylanpince
• Slides: https://speakerdeck.com/taylanpince/tensorflow-neural-networks-on-ios
• Links:
  • http://machinethink.net/blog/tensorflow-on-ios/ - Great introductory tutorial on gathering your data, training on a custom model, setting up TensorFlow, converting to a mobile optimized network, and loading it up on an iOS app
  • http://www.reza.codes/2017-07-29/how-to-train-your-own-dataset-for-coreml/ - Detailed tutorial on how to train your own model for CoreML
• Interesting (Related) Projects
  • ImageNet - open DB of pre-tagged images
  • Kaggle - https://www.kaggle.com/ - The Home of Data Science & Machine Learning
• Very much "trial and error", not "science"
• 10% of your "data" should be used for training data, and the remaining for testing
  • don't cross the streams!
• Tensorflow
  • produces a pb file
  • C++ Library
  • Adds about 40MB to final binary size
  • Can't use bitcode
  • Cannot use GPU (uses CPU)
  • Tensorflow - use freeze_graph & optimize_for_inference
  • Import final pb file into Xcode project
• CoreML
  • Pretrained Models
    • Inception v3
    • VGG16
    • MobileNet
    • SqueezeNet
  • Custom Models
    • Convert Caffe or Keras models with coremltools
    • import mlmodel into your xcode project
• Metal
  • Low-level API behind CoreML
  • Always runs on GPU
  • Got tons of love with iOS11 updates
  • Apple has the full inception v3 model implemented in model as sample code
  • Convert pb file into a binary metal can read
• Recap
  • Train with TensorFlow + Keras
  • Use CoreML if you can
  • Use TF if you need multi-platform
• Lots of Apple Samples

Life Beyond Storyboards

• Presenter: Ryan Poolos
• Slides:
• Layout Anchors

IMPLEMENTING CONTINUOUS DELIVERY WITH IOS

• Presenter: Cassie Shum
• Slides: https://speakerdeck.com/cassiend/ios-with-continuous-delivery

OVERCOMING THE STRESS SURROUNDING CODE REVIEW, FOR THE BETTERMENT OF YOUR PROJECT AND CAREER

• Presenter: Mike Zornek
• Slides: https://github.com/intere/360iDev2017/blob/master/presentations/zornek-code-review-360idev.pdf

THREADS, QUEUES, AND THINGS TO COME: THE PRESENT AND FUTURE OF CONCURRENCY IN SWIFT

• Presenter: Ben DiFrancesco
• Slides: https://github.com/intere/360iDev2017/blob/master/presentations/Threads-Queues-Things-To-Come-Slide-Archive.key
• Sample Code: https://github.com/apbendi/ConNews
• GCD, (NS)Operation

IF YOU CAN LEARN IT, YOU CAN TEACH IT

• Presenter: Tammy Coron
• Slides: https://drive.google.com/open?id=0B_oWPP0vddVVc2JIQzV2SXM5UkE

STARTING, GROWING AND RUNNING A SUCCESSFUL DEVELOPER MEETUP

• Presenter: Mike Zornek
• Slides: https://github.com/intere/360iDev2017/blob/master/presentations/zornek-meetup-360idev.pdf

THE RIGHT S FOR THE JOB

• Presenter: Tyler Burgett
• Slides: https://speakerdeck.com/tyburg/the-right-s-for-the-job

NOTIFICATION HANDLING ON WATCHKIT

• Presenter: Eric Blair
• Presentation + Sample Code: https://github.com/jablair/360iDev-WatchKitNotifications

ADVANCED DRAWING TECHNIQUES WITH UIBEZIERPATH AND APPLE PENCIL

• Presenter: Nick Dalton
• Slides / Code Samples: https://github.com/iNick/360iDev-2017

Wednesday (August 16)

ADVANCED BUILDING APPS FOR APPLE WATCH

• Presenter: Justin Domnitz
• Slides: https://github.com/justindomnitz/iDev2015_watchOS

HOW I LEARNED TO STOP WORRYING AND LOVE AUTOLAYOUT

• Presenter: Jonny Klemmer
• Slides: https://speakerdeck.com/jonnyklemmer/how-i-learned-to-stop-worrying-and-love-auto-layout

HOW OPEN SOURCE DEVELOPMENT CAN MAKE YOU A BETTER DEVELOPER

• Presenter: Arthur Sabintsev
• Slides https://github.com/ArtSabintsev/360iDev-2017

THE INTERNET OF THINGS AND IOS: DONT LET YOUR TOASTER BRING DOWN THE INTERNET!

• Presenter: Florian Harr
• Slides: https://speakerdeck.com/evils/the-internet-of-things-and-ios-dont-let-your-toaster-bring-down-the-internet

THE LATEST IN DEVELOPING FOR WATCHOS

• Presenter: Conrad Stoll
• Slides: https://speakerdeck.com/cnstoll/the-latest-in-developing-for-watchos
• Sample Code: https://github.com/cnstoll/Snowman
  • Snowman watch game:
    • uses CoreML for handwriting recognition as input to

CONTRIBUTING TO SWIFT

• Presenter: Neil Kimmett
• Slides: https://github.com/intere/360iDev2017/blob/master/presentations/Contributing%20to%20Swift.pdf

LEGAL ISSUES IN IOS DEVELOPMENT

• Presenter: Michael Schneider
• Slides: https://github.com/intere/360iDev2017/blob/master/presentations/360-iDev%20Legal%20Issues%20in%20iPhone%20Dev%202017%20(for%20PDF).pdf

REVERSE ENGINEERING THE IOS SIMULATORS SPRINGBOARD

• Presenter: Derek Selander
• Sample Code: https://github.com/DerekSelander/lldb

This talk was a hands-on demo where Derek used LLDB + his own suite of tools (see the git repo above and Facebook's chisel for more detail) to hack springboard. You need to be a bit more than a script-kiddy to be able to do what he does here. Great demo!