A SMART TOUCH-FREE MIRROR FOR PRODUCTIVE UTILIZATION OF HUMAN TIME A PROJECT REPORT Submitted By Aravindh
A SMART TOUCH-FREE MIRROR FOR PRODUCTIVE UTILIZATION OF HUMAN TIME
A PROJECT REPORT
Submitted By
Aravindh. N (140051601007)
Mariyam Hibah. M. M (140051601038)
Under the guidance of
Mrs. A. PRIYA A/P ECE
in partial fulfillment for the award of the degree of
BACHELOR OF TECHNOLOGY
In
ELECTRONICS AND COMMUNICATION ENGINEERING
April 2018
i
www.bsauniv.ac.in
BONAFIDE CERTIFICATE
Certified that this project report “A SMART TOUCH-FREE MIRROR FOR PRODUCTIVE UTILIZATION OF HUMAN TIME” is the bonafide work of “ARAVINDH. N (140051601007), MARIYAM HIBAH. M. M (140051601038)” who carried out the project work under my supervision. Certified further, that to the best of our knowledge the work reported herein does not form part of any other project report or dissertation on the basis of which a degree or award was conferred on an earlier occasion on this or any other candidate.
SIGNATURE
Mrs. A. PRIYA
SUPERVISOR
Assistant Professor
Department of ECE
B.S. Abdur Rahman Crescent Institute of Science and Technology
Vandalur, Chennai – 600 048
ii
SIGNATURE
Dr. C. THARINI
HEAD OF THE DEPARTMENT
Professor & Head
Department of ECE
B.S. Abdur Rahman Crescent Institute of Science and Technology
Vandalur, Chennai – 600 048
VIVA VOCE EXAMINATION
The viva voce examination of this project work titled “A SMART TOUCH-FREE MIRROR FOR PRODUCTIVE UTILIZATION OF HUMAN TIME” submitted by ARAVINDH. N (140051601007), MARIYAM HIBAH. M. M (140051601038) is held on __________________________.
INTERNAL EXAMINER EXTERNAL EXAMINER
iii
ACKNOWLEDGEMENT
Support on demand, encouragement at the needed moment and guidance in the right direction are in dispensable for the success of any project.
First and foremost, my sincere thanks to the almighty for giving me an opportunity to do my under graduation in an esteemed institution and making me to complete this project successfully. I sincerely express my heartfelt gratitude to Dr. V. MURUGESHAN, Registrar and Director, B.S. Abdur Rahman Crescent Institute of Science and Technology for this kind patronage.
I sincerely express my gratitude to Dr. C. THARINI, Professor and Head, Department of ECE, B.S. Abdur Rahman Crescent Institute of Science and Technology for her total support and encouragement throughout my project.
I extend my heartfelt thanks to our project coordinator Mrs. VANMATHI, Assistant Professor, Department of ECE for her constant encouragement, valuable suggestion and her keen interest in making me to complete this project.
I take this opportunity to express my gratitude and regards to our internal guide Mrs. A. PRIYA, Assistant Professor, Department of ECE, B.S. Abdur Rahman Crescent University of Science and Technology for her great words of motivation which a long way in making our project possible and productive.
In particular I am grateful to my class advisor Mrs. R. ANITHA, Assistant Professor, Department of ECE, B.S. Abdur Rahman Crescent University of Science and Technology for the huge encouragement.
iv
I would also like to thank my dear parents, the faculty members of the department and my friends who directly or indirectly helped me in the completion of my project.
v
ABSTARCT
Efficiency and productivity are the two qualities that are increasingly establishing their dominance as keywords by companies to market their products. The real selling point is the fact that their product can increase productivity i.e. multitask better than their competition is to be noted. An essential factor to increase productivity of day-to-day life is in effective time management. The best time management strategies involve being able to find time where there was no time before. One factor that has made time management possible is the integration of technology into people’s daily lives. The use of products such as tablets, PCs, and smartphones have given people access to the tools needed to be productive.
The idea for our project, a touch-free mirror maximizing time efficiency also called as smart mirror or magic mirror, is based on the principle that technology should mold to the user’s schedule, not the other way around. This project aims to effectively manage time by seamlessly integrating technology into people’s lives by putting it where everyone’s routine eventually collides, in front of a mirror. The main aim of smart mirror is to save time by increasing the user’s productivity spent in front of a mirror. A relatively easy and near effortless experience is provided by the smart mirror which allows the user to just walk in front and be greeted with an assortment of information all at one place, thereby saving time and minimizing the need for another device.
Despite the fact that this information can be found on the user’s other devices, it’s the time saving convenience of having all this information available at the same place and at the same time gives this project an edge over the other regular devices.
vi
TABLE OF CONTENTS
CHAPTER TITLE PAGE NO.
1 ABSTRACT vi
2 LIST OF TABLES ix
3 LIST OF FIGURES x
4 LIST OF ABBRIVATIONS 1 INTRODUCTION 1.1 OBJECTIVE 1.2 EXISTING SYSTEM 1.3 PROPOSED SYSTEM 1.4 PROPOSED SYSTEM ARCHITECTURE 2 LITERATURE SURVEY 3 HARDWARE REQUIREMENT AND SPECIFICATION 3.1 RASPBERRY PI 3.2 RASPBERRY PI CAMERA 3.3 MONITOR 3.4 TWO WAY MIRROR 3.5 HDMI TO VG CONVERTER 3.6 SPEAKER 3.7 SOUND CARD 3.8 MICROPHONE 4 SOFTWARE USED 4.1 4.2 4.3 vii 5 CODING 5.1 5.2 5.4 5.5 5.6 5.7 5.8 5.9 5.10 6 OUTPUT 6.1 6.2 6.3 6.4 6.5 7 CONCLUSION 8 SCOPE FOR FUTURE WORK 9 REFERENCES 10 APPENDICES 11 TECHNICAL BIOGRAPHY viii LIST OF TABLES Table 3.1 Comparison between the Raspberry Pi models 10
ix LIST OF FIGURES Fig. 1.1 Block Diagram of the Proposed System 3
Fig. 3.1 Raspberry Pi 3 9
x
CHAPTER 1
INTRODUCTION
1.1 OBJECTIVE
Lifestyle of this era has been changed in such a way that comprising time is the most difficult task. Today’s generation look for smartness in everything they handle. Comprising time is not possible but things need to be done on time. There are conventional ways to remember things but they become ineffective at times of urgency. In order to overcome this, there are several techniques to keep one updated about one’s daily activities. Though mobile phones are playing a vital role in one’s daily routine, a smart technique is required to make even more productivity of one’s time and day.
A Smart Mirror is a development of one such technique which keeps updating one’s daily routine when they are getting groomed before the mirror for their work. Basically, a smart mirror is an innovative appliance that incorporates interactive services of information, offered through a user interface on the surface of a mirror. The smart mirror is proposed with an idea that when one looks at the mirror before going out, the time spent in front of the mirror must be useful. The smart mirror displays services like climate – data, time, date, daily appointments, and emails on its surface by facial identification. It can further be enhanced by connecting it to other home appliances and devices using IOT.
The smart mirror has the necessary applications and features needed for time efficiency focused device. When a user stands in front of the mirror, it automatically recognizes the user and then turns on the monitor hidden behind a two-way mirror. The display used is a 20″ monitor which is mounted behind a two-way mirror is surrounded by a wooden frame structure secured with clamps gives the mirror structure. This encasing also includes the speakers, pi camera and also the PIR sensor. A suit of desired applications is displayed on the 20″ monitor, thus effectively maximizing the time spent in front of a mirror.
1.2 EXISTING SYSTEM
The concept of a smart mirror or a magic mirror is relatively new but not unknown. The existing system uses either a Raspberry Pi, Microcontroller or a central computer with Windows 8.1 or iOS featuring a multi-core CPU. These systems either have a voice identification or sound identification as a main module. All the existing system has the very basic information like weather data, time and date as their basic modules. The additional modules can be added accordingly to the user’s preference. The type of mirror used in the existing model is either a two-way mirror or two-way acrylic sheets. Also, the size of the monitor depends on the user’s preference.
1.3 PROPOSED SYSTEM
Significant research had to be done to develop a backdrop of our project. Firstly, similar projects and products had to be investigated and researched to know what has been done, how has it been done and what can be possibly added to make our project standout from the rest. Next, to decide on the best product to use in our smart mirror system, the individual pieces making up the mirror framework had to be researched.
The proposed system uses Raspberry Pi 3 Model B since this has additional features when compared to Raspberry Pi Zero, Pi 1 and Pi 2. The main advantage of Pi 3 when compared to earlier models is its better CPU clock rate and better RAM. Also, the Pi 3 has Wi-Fi and Bluetooth whereas the Pi 2 needs an USB adaptor to add them. The architecture of Pi 3 has 64-bit while Pi 2 has 32-bit giving it a boost, thereby giving the user a better performance. Hence all the advantages seen in Raspberry Pi 3 makes us to choose the Pi 3 over the other models.
The mirror used in the proposed system is a two-way mirror. This is preferred over the acrylic sheets as they tend to break easily. Also, the monitor chosen for this project is 20″ HP monitor. This displays the content to the user. The modules used in this design are the weather data, time, date, holidays, news headlines, traffic estimation, traffic routes and alternative routes to a specific place, timetable for a particular user, emails, notifications, events information etc. to name a few. Additionally, a PIR sensor is used to switch on and off the monitor and face identification is used to access the display personalized for each specific user.
1.4 PROPOSED SYSTEM ARCHITECTURE
The Fig. 1.1 gives the architecture of the proposed smart mirror framework. The monitor is kept behind the two-way mirror. The mirror can display the user’s face as well as the content displayed on the mirror. The CPU used as the mirror framework is the Raspberry Pi 3. This Pi 3 is hooked behind the monitor. The mirror is encased in a wooden frame secured tightly by clamps. The Pi camera is connected to Pi 3 and placed on top of the wooden frame to capture the image of the person standing in front of the mirror. The speakers and microphone are also attached to the Pi 3 and they are placed on either side of the frame for better audio.
395605077470News/RSS
00News/RSS
3733800201930002527300204470002419350208280003289300220980003181350227330002416810328930SMART MIRROR CPU
RASPBERRY PI 3
00SMART MIRROR CPU
RASPBERRY PI 3
1606550210820008382001892300093345029718020″ HP
MONITOR
TO
DISPLAY
0020″ HP
MONITOR
TO
DISPLAY
83820020193000330200208280MIRROR
00MIRROR
397510081280Notifications
00Notifications
375285020574000365760022733000365760088900032893002876550032893004064000
399415046990Weather/Date
00Weather/Date
373380016573500365760018732500328930023558500172720035115500
405765019685Traffic
00Traffic
4019550321945Google API modules
00Google API modules
37020503632200037973008382000370205012192000328930015049500
4000500271145And other modules
00And other modules
3797300463550037528502552700036830001701800032893004635500328930021780500318135028765500
3098165301625Voice Command
00Voice Command
1880235361315Facial Recognition
00Facial Recognition
2330450590550028956008124000160020047625008382002036000
3181350334645Microphone ; Speaker
00Microphone ; Speaker
1695450334565Camera
00Camera
Fig. 1.1: Block Diagram of the Proposed System
CHAPTER 2
LITERATURE SURVEY
A literature survey or a literature review in a report is the section which shows the various analyses and research made in the field of interest and the results already published, taking into account the various parameters of the project and the extent of the project. Literature survey are secondary sources, and do not report new or original experimental work. The goal of the literature survey is to establish a theoretical framework for the project of our interest.
1 Jun-Ren Ding, Chien-Lin Huang, Jin-Kun Lin, Jar-Ferr Yang and Chung-Hsien Wu describes a mirror system that is interactive with the user which includes speech recognition, face detection and a 3 – dimensional (3D) graphic generator. The Magic mirror in 1 uses a microphone and speakers for the speech activated applications. A reflective glass, camera and LCD are used for displaying the content on the mirror. In addition to displaying the basic necessities like date, climatic data and daily reminders this can also display additional information like weather, stocks and news from the Internet.
Features of this proposed work:
Has voice recognition and thus uses speakers and microphone.
A LCD is used as a display.
Can also display additional information based on RSS feeds from the Internet.
2 M. Anwar Hossain, Pradeep K. Atrey and Abdulmotaleb El Saddik describes a mirror framework that is a technologically augmented interaction device. This mirror allows for facial based authentication i.e. it will give personalized information like newsfeed, reminders and personalized widgets for different user. It uses a touch based flat screen and also has a web camera. This mirror can also control household appliances since it has remote access to all the smart appliances connected to the server. Using this mirror, the live feed from the home surveillance system can also be monitored.
The points to be noted are:
Uses facial recognition.
Touch based flat screen is used as display.
Uses web camera to monitor the live surveillance feeds.
Can also be connected to other devices and can also control them.
3 S. Athira, Frangly Francis, Radwin Raphel, N. S. Sachin, Snophy Porinchu, Seenia Francis proposed a mirror frame having basic functionality like displaying the weather, time, date and also incorporates additional functionality using mobile synchronization and social media. In this paper, the proposed work has a LCD module which is mounted behind a one-way mirror. This mirror detects the human presence using the Passive Infrared Sensors and needs Wi-Fi connectivity. This also incorporates speech recognition (done using Jasper software) to perform simple tasks like playing a song when a command is given. The proposed mirror uses Raspberry Pi board.
Hence the important points to be noted are:
Mirror uses Raspberry Pi as their CPU.
Display is LCD module.
Uses Passive Infrared Sensors to detect human presence.
Uses voice control and speech recognition using Jasper software.
4 Derrick Gold, David Sollinger and Indratmo proposed a smart mirror working on Raspberry Pi and uses a touch screen mounted on the Pi to control the mirror. The smart mirror designed in 4 follows the Model-View-Controller (MVC) design pattern. Here the Model refers to plugins created using any programming language that manages data to be displayed like weather, date and time. The View is the screen/mirror that displays the data. The Controller is the server component that controls the execution of each plugin. The communication between the plugins and the display is done using WebSocket protocol.
This mirror framework has
Raspberry Pi is used here as the CPU.
The display used is a touch screen.
Is based on the Model-View-Controller (MVC) design pattern.
Since any programming language can be used to create the plugins, a lot of modules can be added personalized to each user.
5 Muhammad Mu’izzudeen Yusri, Shahreen Kasim, Rohayanti Hassan, Zubaile Abdullah, Husni Ruslai, Kamaruzzaman Jahidin and Mohammad Syafwan Arshad built a prototype that incorporates the Internet of Things (IoT) with the mirror framework. This prototype uses Raspberry Pi and Sonus Technology as a way to communicate between the user and the interface. This is a voice activated system similar to Alexa, Jasper and Google Now. When a particular keyword is detected, the mirror displays information like weather, time, date, traffic and also the map which is relevant to the user. This can also control the lamp settings since it is connected with IoT.
This proposed mirror has the following features:
Raspberry Pi is used.
Is controlled by voice activation.
Uses a Sonus Technology which is similar to Alexa, Jasper and other voice-controlled software.
Since connected with Internet of Things (IoT) can perform a magnitude of applications. One such example is the control of lamp.
6 Mohammed Ghazal, Tara Al Hadithy, Yasmina Al Khalil, Muhammad Akmal, and Hassan Hajjdiab proposed a smart mirror that allows the user to control IoT based smart household appliances and also access the customizable personalized services. This design differs from the rest due to its emphasis on the personalization of the user profile. This system works on a server-client architecture, which consists of a web server and a database. The preferences of all the users and their corresponding customized services along with a unique identification number are stored in the database server. This framework uses two dedicated mobile applications and a hardware structure made up of a two-way mirror and a television screen. This system uses a Bluetooth protocol to automatically connect to the users based on the received signal strength indicator (RSSI) of the media access control (MAC) address of the nearby device. A variety of services is provided by the mobile application where the user can customize to their desire. This system can further be enhanced by integrating with fitness tracking readings such as weight, heart rate, glucose levels, blood pressure, diabetes control plan and sleep quality.
The important points are:
Can be connected to IoT appliances.
Gives a major emphasis to the customization of mirror contents based on the preference of each user.
Uses a television screen as their display.
Has Bluetooth and can be connected to the users immediately when they are near the vicinity.
By integrating fitness tracking, this can be further enhanced.
CHATPER 3
HARDWARE REQUIREMENT AND SPECIFICATION
3.1 RASPBERRY PI
The Raspberry Pi is a small single board computer. This is a card sized computer that can plugged to a television or a monitor using a HDMI cable. This does not have a keyboard and mouse attached to it and has to be added externally through the USB ports found in it. Since the Raspberry Pi 3 has a lot more features when compared with the other models, Pi 3 is taken for this project. The entire Pi 3 is enclosed in a clear transparent case.
Fig. 3.1: Raspberry Pi 3
The advantage of Pi 3 over the other models is the increased clock speed from 900MHz to 1.2GHz. Pi 3 also has 4 USB ports. But the major advantage of Pi 3 is the addition of wireless connectivity. Pi 3 has both Wi-Fi and Bluetooth for easier and faster connectivity. This eliminated the need for USB adaptors which the Pi 2 uses. Pi 3 has 64-bit architecture when compared to Pi 2 or Pi Zero which has only a 32-bit architecture. This adds a boost of better performance to the clock speed. The RAM of Pi 3 has also been increased from 450 MHz to 900MHz i.e. double the original. A camera port is also found. The Operating System (OS) used with the Pi 3 is Raspbian. Although the Pi 3 has a 64-bit CPU, the Raspbian has only a 32-bit. A considerable number of programming languages have been adapted for the Raspberry Pi. Python, C, C++, Java, Scratch, and Ruby all come installed by default on the Raspberry Pi.
Pi Model B+ Pi Zero Pi 2 Model B Pi 3 Model B
Released 2014 2015 2015 2016
SoC BCM2835 BCM2835 BCM2836 BCM2837
CPU ARM 11 ARM 11 ARM
Cortex – A7 ARM
Cortex – A53
CPU Speed 700MHz
Single Core 1 GHz
Single Core 900MHz
Quad Core 1.2 GHz
Quad Core
RAM 512MB
SDRAM 512MB
SDRAM 1GB
SDRAM 1GB
SDRAM
GPU 250MHz 250MHz 250MHz 400MHz
Storage microSD microSD microSD microSD
Ethernet 10/100 – 10/100 10/100
Wi-Fi – – – 802.11n
Bluetooth – – – Bluetooth 4.0
USB Ports 2 2 4 4
GPIO 40 40 40 40
Table. 3.1: Comparison between Raspberry Pi models
3.2: RASPBERRY PI CAMERA
The Raspberry Pi camera comes with ribbon cable which is connected to the Camera Serial Interface (CSI) found on the Pi 3 board. The camera is a tiny board itself with dimensions 25mm x 23mm x 9mm and weighing around 3 grams, making it easier and useful for application where the size and weight are very important. But this module is only capable of taking images and videos but not sound. This camera module can be used for taking pictures, recording videos, motion detection and for surveillance and security applications. The code to access the camera and take images/videos is done through python programming language. Since we are only going detect the person in front of the mirror, a 5MP resolution camera is enough. The sensor found in the 5MP camera module is OmniVision OV5647.
Fig. 3.2: 5MP Camera Module
3.3 MONITOR
The monitor is used to display the personalized information and contents on it’s screen. This will be mounted behind the two-way mirror. An array of devices can be used as display, the prominent ones being a LCD or a LED television, a touch screen monitor or a regular monitor. This display selection is based on personal preference. Since we are only building a prototype, we have opted for a 20″ HCL.
3.4 TWO WAY MIRROR
A two-way mirror is placed in front of the monitor. This serves as a mirror and also displays the contents on the monitor on the surface of the mirror. Since in a regular mirror, after the back pane of the glass is given a coating of reflective material in a process called silvering, it is painted black. This is done in order to ensure that all the light is reflected forward, making it impossible for the light to pass through it.
17272002597150Mirror Surface
00Mirror Surface
22542502679700030924502711450032448502641600In a two-way mirror, the glass is partially reflective and partially transparent i.e. semi-transparent. Here the glass is coated with a thin layer of metal (usually aluminium). This layer is very thin and almost transparent thereby allowing only half the light to reflect back while the rest passes or penetrates through it. When the display is switched off, this acts like a regular traditional mirror and the user is able to see their face. When the display is on, the content on the monitor as well as the user’s face can be seen on the mirror surface since this is semi-transparent. In simpler terms, when the display behind it is black or darkened, it must behave like a regular mirror, and when information is displayed on the monitor, it should be like a glass window.
3460750260350Monitor (Display is switched off)
00Monitor (Display is switched off)
9017002603501473200260350200660095250
349885544409334503467109334501879609017001841514732003511551473200165101473200189865
93345028067093345013462014732002806701473200128270
95250019240597155052705014732001924051473200527052311400205105
100965091440All the light gets reflected back and hence behaves like a regular mirror.
0All the light gets reflected back and hence behaves like a regular mirror.
Fig. 3.4.1: When the display is switched off 230505045656501657350283210Mirror Surface
00Mirror Surface
3283585417830
3553460284480Monitor (Display is switched on)
00Monitor (Display is switched on)
100965026289023114002603503133090463550200660095250
102870035941010071102095504832356079010096505016523749003467102374900184152374900187960
1028700125730102870027813023749002806702406650128270
628650272415Only half the light gets reflected back while the rest penetrates and hence displays both the content and the user’s face.
00Only half the light gets reflected back while the rest penetrates and hence displays both the content and the user’s face.
100965037465231140052705231140090805
Fig. 3.4.2: When the display is switched on
