PocketDoc

Pocketdoc is a mobile app which uses machine learning to advise cures to people with common recognizable symptoms

Installation Instructions

1. Go to directory and run npm install
2. Connect android or ios phone to computer
3. Run react-native run-android of react-native run-ios
4. Run react-native start
5. Open app on your android or ios phone.

Inspiration

After reading the news and learning that 63 million people are faced with poverty every year in India due to healthcare expenditure alone, I was shocked. I had worked with image recognition and machine learning before so I set out to solve this problem in my own way.

What it does

PocketDoc is an image recognition app to identify physical wounds on the human body and return cures. All you have to do is take a picture of your wound/symptom and then let PocketDoc recognise your wound and return the most common cure or medicine!

Features

• Cross-platform - works for iOS and Android!
• Clean material design layout
• Image recognition trained by custom models
• Fast response time due to image compression when sending to API

How I built it

My time on this project was split 50-50. The first half of my time was learning react-native and developing the cross platform interface. Next, I had to learn a bit of machine learning using Clarifai's Image recognition API. I then spent time training my own custom model using predictive analysis to recognise common physical wounds .

Challenges I ran into

I could not find a working cross-platform camera solution in react native surprisingly so I had to find my way around different tutorials and stack-overflow threads to find an amazing package called react-native-image-picker. This saved me loads of time.

Accomplishments that I'm proud of

I am very proud of the fact that I accomplished this task solely on my own. It helped me develop more independence and also develop lots of confidence in my coding ability.

What I learned

• Machine Learning
• Image Recognition
• How to build cross platform apps in React Native

What's next for PocketDoc

Right now this app is at a very early stage in development. The minimum viable product has been implemented and everything works. However, in the future I am aiming to reach out to medical research universities and societies and see if I can obtain access to databases of wounds. Then I will feed all images through the image recognition model and this app will be more powerful and more helpful to people in developing countries!