Archives of Industrial Biotechnology

All submissions of the EM system will be redirected to Online Manuscript Submission System. Authors are requested to submit articles directly to Online Manuscript Submission System of respective journal.
Reach Us +1 (629)348-3199

Research Article - Archives of Industrial Biotechnology (2021) Volume 5, Issue 1

A project report on Intelli Glove using IOT

Shubham Suman*, Raj Kumar, Sujeet Kumar

Department of Computer science, Maulana Abul Kalam Azad University of Technology, West Bengal, India

Corresponding Author:
Shubham Suman Department of Computer science, Maulana Abul Kalam Azad University of Technology, West Bengal, India Email: subhamsuman16@gmail.com

Accepted date: Aug 2, 2021

Citation: Suman S, Kumar R, Kumar S, et al.. A project report on Intelli Glove using IOT Arch Ind Biotechnol 2021;5(1):1-5.

Abstract

In this paper we have a tendency to represent sensible glove for deaf and dumb patient. concerning 9 million individuals within the world are deaf and dumb. The communication between a deaf traditional visual individuals. This creates a really very little area for them with communication being a basic facet of human life. The blind individuals will speak freely by suggests that of traditional language whereas the deaf-dumb have their own manual-visual language referred to as language. language could be a non-verbal kind of intercourse that is found amongst deaf communities in world. The languages don't have a standard origin and therefore troublesome to interpret. The project aims to facilitate individuals by suggests that of a glove primarily based communication interpreter system. The glove is internally equipped with 5 flex sensors. for every specific gesture, the flex device produces a proportional amendment in resistance. The process of those hand gestures is in Arduino uno Board that is Associate in Nursing advance version of the microcontroller and also the LABVIEW software package. It compares the signaling with predefined voltage levels hold on in memory. per that needed sound is made that is hold on is memory with the assistance of speaker. In such some way it's simple for deaf and dumb to speak with traditional individuals.

Visit for more related articles at Archives of Industrial Biotechnology

Abstract

In this paper we have a tendency to represent sensible glove for deaf and dumb patient. concerning 9 million individuals within the world are deaf and dumb. The communication between a deaf traditional visual individuals. This creates a really very little area for them with communication being a basic facet of human life. The blind individuals will speak freely by suggests that of traditional language whereas the deaf-dumb have their own manual-visual language referred to as language. language could be a non-verbal kind of intercourse that is found amongst deaf communities in world. The languages don't have a standard origin and therefore troublesome to interpret. The project aims to facilitate individuals by suggests that of a glove primarily based communication interpreter system. The glove is internally equipped with 5 flex sensors. for every specific gesture, the flex device produces a proportional amendment in resistance. The process of those hand gestures is in Arduino uno Board that is Associate in Nursing advance version of the microcontroller and also the LABVIEW software package. It compares the signaling with predefined voltage levels hold on in memory. per that needed sound is made that is hold on is memory with the assistance of speaker. In such some way it's simple for deaf and dumb to speak with traditional individuals.

Keywords

Intelli Glove, flex sensor, sign language, Labview, Arduino Uno, Dumb people, Gesture language.

Introduction

In our life we tend to meet several disable folks, a number of them square measure partly and a few square measure fully disables. The partly impaired folks like dumb, deaf, disfunction in one leg or hand manages their life with difficulties and feel break free others. Here communication plays major role to feel somebody higher associated gratification them in an activity wherever they'll say themselves as freelance person. By this thought the project sensible Hand Gloves for Disable folks is developed in order that disable person will live his life as he desires. In this project, Flex sensing element plays the main role. The glove is fitted with flex sensors on the length of every finger and also the thumb. The flex sensors provide output within the type of voltage variation that varies with degree of bend. This flex sensing element output is given to the ADC channels of microcontroller. It processes the signals and perform analog to digital signal conversion. any the processed information is distributed in a very wireless manner to the receiver section. during this section the gesture is recognized and also the corresponding output is displayed on LCD and at the same time a speech output is play backed through speaker. The movableness of this project could be a major advantage. so with the assistance of this project, the barrier Janus- faced by these folks in communication with the society may be reduced to an excellent extent.

The signing detection and recognition systems have chiefly one amongst the 2 following methodologies viz. vision based mostly} or image process technique and sensors and microcontroller based glove. within the image process technique, the camera is employed to capture the gestures. These gestures area unit captured in terms of pictures and these pictures area unit analyzed victimisation totally different algorithms to acknowledge the which means of a selected gesture. One such technique is mentioned in , wherever a desired hand gesture sequence is made by enlivening the corresponding key gesture frames with the assistance of extracted info. The disadvantage of image process primarily based technique is that it needs developing of complicated process algorithms so as to find the gestures. additional this system additionally needs correct lighting conditions, correct backgrounds and field of read limitations.

The next approach is to use Accelerometers and Flex sensors to find the movement of hands. within the authors didn't use advanced microcontrollers and therefore a separate ADC style was needed to live sensing element readings. additional exclusion of wireless transmitters makes the system complicated as a result of wires. Within the logic levels of LCD and MSP430F149 didn't match for interfacing functions. Therefore, the authors used ATMEGA sixteen for interfacing LCD. an added approach is mentioned that during which|within which} uses Sharojan Bridge and a number of other Arduino boards which makes the system very little large and large.

Using the thought of gestures, few makes an attempt are created within the past to acknowledge the gestures created victimization hands however with limitations of recognition rate and time that include:

1. victimization CMOS camera

2. Leaf switches primarily based glove

3. Copper plate primarily based glove

4. Flex device primarily based glove

A. victimization CMOS Camera CMOS camera transmits image information via UART interface. The UART performs serial-to-parallel conversions on information received from a peripheral (CMOS camera during this case) and parallel-to-serial conversion on information received from the hardware (Microcontroller during this case). Hand gestures were detected victimization CMOS camera by three steps

• Capturing the image of the gesture
• Edge detection of that image
• Peak detection of that image Disadvantage: extremely pricy, latency and every image occupy 50KB of recollections.

B. Leaf switches primarily based glove these ar the same as traditional switches however these ar designed in such the way that once pressure is applied on the switch, the 2 ends inherit contact and therefore the switch are going to be closed. These leaf switches ar placed on the fingers of the glove specified the 2 terminals of the switch inherit contact once the finger is bent. Disadvantage: once prolonged usage, the switch rather than being open once the finger is straight, it'll be closed leading to improper transmission of gesture.

C. Copper Plate primarily based Glove during this model, a copper plate is fastened on the palm as ground. The copper strips indicate a voltage level of logic one in rest position. however once copper strips are available contact with the bottom plate, the voltage related to them is drained and that they indicate a voltage level of logic zero. Disadvantage: the utilization of copper plate makes the glove large that makes it unsuitable to use it for a protracted time.

D. Flex sensing element primarily based glove Flex suggests that suggests that or „curve”. sensing element refers to a electrical device that converts physical energy into voltage. Flex sensing element may be a resistive sensing element that modifications its resistance as per the change in bend or curvature of it into analog voltage. this can be a hap twitch primarily based approach that consists of exploitation flex sensors to require in physical values for process. mentioned below is one recent technology of this paradigm.

Investigation

Report on present investigation

Many good gloves area unit planned in recent years wherever most popular technology was wireless mode with several distinct options, however those weren't reliable, lightweight weight, cheap, simple to use, plug and play sort prototypes. it's thanks to parts used for fabrication that area unit unremarkably offered in market like flex sensors, microcontroller, and wireless transmitter, and these were steam-powered by battery that was very little significant as compare to alternative parts. Therefore, these forms of assemblies area unit large, and tough to use. In an endeavor to open up the lines of communication and to spark a language between those who area unit hard-of-hearing or have speaking disabilities, a student and designer at Goldsmiths University in London has developed a futurist smart-glove named “Sign Language Glove” that's capable of translating language from hand gestures into a visible on-screen text likewise as sounding dialogue. benefits and disadvantage area unit as follow:-

• It is wireless with displays and voice device.
• It is moveable, and having integral battery.
• It is large in sporting. • Difficult to handle.
• It is delicate and parts area unit high-priced.

There area unit 2 major elements developing the project. These are:-
• Circuit style and Construct

The sensible Glove has many elements as listed below:-

A. Microcontroller: (Arduino applied scientist) the most controller chosen for the project is that the Arduino Leonardo. it's a microcontroller based mostly board on the ATmega32u4. The microcontroller has twenty digital input output pins as well as seven pins which will be used as PWM outputs and twelve pins as analog inputs.

B. Flex Sensor: Flex detector is that the most fitted detector to live and capture the movement of the fingers. once detector placed in gloves is bent, it produces a resistance output related to the bend radius- the smaller the radius, the upper the resistance worth. The bending resistance vary for flex detector varies just about from 45Kohm to 125Kohms.

C. measuring system: Accelerometer is employed to live the quantity of static acceleration thanks to gravity. Therefore, measuring system will determine the angle of the glove at that it's atilt with relevance the world. The measuring system is connected within the middle of the glove to live the angle of atilt glove. The measuring system uses one structure for sensing x, y and z axis.

D. Blue bee Bluetooth Module: A Bluetooth module is employed to transfer the info from microcontroller to sensible phone. It comes with Associate in Nursing on-board antenna. It acts sort of a clear port, that works with a range of Bluetooth adapter and phone. operational voltage is three.0-3.6V.

E. Arduino Software: The Arduino IDE (Integrated Development Environment) could be a cross platform application written in java, and comes from the IDE for process artificial language and inscribing this example. It includes a code editor with options like syntax highlight, brace matching and automation indentation and is additionally capable of compilation and uploading programs to the board with one click.

F. App artificer Software: it's the computer code to form a mobile application for sensible phone employing a browser. It solely supports mechanical man.

Drwabacks Definition

Problems two-faced by the disable person relating to employment is overcome by our technique. thus within the enforced work Associate in Nursing intelligent microcontroller based mostly system victimisation Flex sensors is developed that is in a position to-

• Convert gesture into voice and text.
• Help an individual to manage his home appliances if he couldn't walk to plugboard.

In today’s technology wireless gloves don't seem to be nevertheless reliable as a result of to be used as wireless, the gloves ought to have intrinsic battery and a few physics controller board that makes gloves heavier and will cause irritation. therefore wired equipment’s square measure most well-liked for patients and partial disable folks.

Materials and Methodology

In this system at the transmitter facet we tend to use a glove that needs to be worn by the user. This glove is mounted with four flex sensors every on the four fingers of the glove particularly thumb, index, middle, ring. The flex sensors offer their output within the style of modification in resistance in keeping with the bend angle. The output from the flex sensors is given to the ADC channels of the microcontroller. The processed ADC values from the microcontroller area unit compared with the brink values for the popularity of a specific gesture. the actual gesture is recognized & is given to the microcontroller that transmits them through the RF module during a serial manner. For each value received at RF receiver, the microcontroller gives corresponding commands to the LCD and the Voice Module. Thus we get the voice output for each gesture and display of each gesture in form of text on the LCD display.

The ATmega16 may be a low-power CMOS 8-bit microcontroller supported the AVR increased reduced instruction set computer architecture} architecture. The ATmega16 provides the subsequent features: sixteen Kbytes of In-System Programmable Flash Program memory with Read-While-Write capabilities, 512 bytes EEPROM, one Kbyte SRAM, thirty two general purpose I/O lines, thirty two general purpose operating registers, a JTAG interface for Boundary scan, On- chip Debugging support and programming, 3 versatile Timer/Counters with compare modes, Internal and External Interrupts, a serial programmable USART, a computer memory unit minded Two-wire Serial Interface, associate degree 8-channel, 10-bit ADC with elective differential input stage with programmable gain (TQFP package only), a programmable Watchdog Timer with Internal generator, associate degree SPI port, and 6 package selectable power saving modes. The Idle mode stops the processor whereas permitting the USART, Two-wire interface, A/D convertor, SRAM; Timer/Counters, SPI port, and interrupt system to continue functioning. The Power-down mode saves the register contents however freezes the generator, disabling all alternative chip functions till succeeding External Interrupt or Hardware Reset. In Power-save mode, the Asynchronous timer continues to run, permitting the user to keep up a timer base whereas the remainder of the device is sleeping. The ADC Noise Reduction mode stops the processor and every one I/O modules except Asynchronous Timer and ADC, to reduce change noise throughout ADC conversions. In Standby mode, the crystal/resonator generator is running whereas the remainder of the device is sleeping. this enables in no time start-up combined with low-power consumption. In Extended Standby mode, each the most generator and also the Asynchronous Timer still run. thence we tend to used AVR (ATMEGA16) microcontroller rather than 8051 microcontroller.

Flex detector (Bend Sensor)

In this device the hand gestures square measure recognized exploitation flex detector. These sensors square measure hooked up to the gloves. Flex sensors square measure just like potentiometer, i.e. rheostat. The resistance of the detector varies in line with the quantity of its bending, that intern depends on the movement of finger. so as to exactly live the bending flex detector square measure used. The flex sensors have a mean flat resistance concerning 10k ohms. Once the detector square measure bent the resistance offered by them will increase.

Accelerometer (Tilt Sensor)

The ADXL335 could be a little, skinny and low power device capable of mensuration complete 3- axis acceleration. The ADXL335 will live acceleration with a minimum full scale vary of ± 3g. It needs less power and provides output signals in terms of analog voltages that ar proportional to acceleration. It will live the static acceleration of gravity in tilt-sensing applications, in addition as dynamic acceleration ensuing from motion, shock or vibration. The 3 axes’ sense directions ar extremely orthogonal and have very little cross-axis sensitivity since it uses one poly atomic number 14 surface-micro-machined sensing element structure for sensing X, Y and Z axes. The user selects the information measure of the measuring instrument exploitation the cardinal, Cy, and Cz capacitors at the Xout, Yout, and Zout pins. Bandwidths is elect to suit the applying, with a spread of zero.5 Hertz to 1600 Hertz for the X and Y axes, and a spread of zero.5 Hertz to five0 Hertz for the Z axis.

Rf transreceiver (Cc2500)

The CC2500 could be a affordable a pair of.4 GHz transceiver designed for terribly low-power wireless applications. The circuit is meant for the 2400- 2483.5 megahertz school of thought (Industrial, Scientific and Medical) and SRD (Short vary Device) waveband. With the combination of extremely configurable baseband electronic equipment, the RF transceiver supports numerous modulation formats and incorporates a configurable rate up to five hundred kBaud.

It provides thirty meters vary with aboard antenna. in a very typical system, this trans-receiver are used in conjunction with a microcontroller. It provides in depth hardware support for packet handling, information buffering, burst transmissions, clear channel assessment, link quality indication and wake on radio. (e.g. RKE-two means Remote keyless Entry, wireless alarm and security systems, AMR-automatic Meter Reading and management, Wireless Game Controllers, Wireless Audio /Keyboard /Mouse). It might simply to style product requiring wireless property. It may be used on wireless security system or specific remote-control operate et al wireless system.

Voice OTP IC (aP8942A)

aP8942A high performance Voice OTP is made-up with customary CMOS method with embedded 1M bits ROM. It will store up to 42sec voice message with 4-bit ADPCM compression at six kc rate. 2 trigger modes, easy Key trigger mode and Parallel C.P.U. trigger mode facilitate totally different computer programme. User selectable triggering and signal choices offer most flexibility to numerous applications. inherent resistance controlled generator, 8-bit current mode D/A output and PWM direct speaker driving output minimize the quantity of external parts. victimization computer controlled technologist and developing software system, we are able to program this IC as per our desires.

Explantion of proposed method

We are working on this project namely Smart Glove that translates hand gestures into a particular message. Flex Sensors fixed with the glove pick up the gesture made by the individual and then with the help of the Arduino that analog input is converted to digital for various gestures. For every particular gesture, there is specific digital output and that digital output for the specific gesture is reserved for a specific message. So, when the individual does that particular gesture, the predefined message for that gesture is displayed on the LCD along with a beep (sound) and that specific message is also transmitted in the form of text or call with the help of GSM module to the various registered numbers.

Flow chart

We ar engaged on this project specifically good Glove that interprets hand gestures into a specific message. Flex Sensors fastened with the glove obtain the gesture created by the individual then with the assistance of the Arduino that analog input is reborn to digital for varied gestures. for each specific gesture, there's specific digital output which digital output for the precise gesture is reserved for a particular message. So, once the individual will that individual gesture, the predefined message for that gesture is displayed on the liquid crystal display together with a beep (sound) which specific message is additionally transmitted within the type of text or decision with the assistance of GSM module to the varied registered numbers.

Results and Discussion

In our system, the one who wears the glove ought to hold it for concerning two seconds so as to observe the actual gesture. each gesture consists of movement and bending of fingers of hand in an exceedingly specific order with specific angle correspondingly. The sensing element values that ar being generated by every of the Flex sensors associated an measuring instrument ar fed to the ADC channel of the microcontroller. for each bending of Flex sensors associated movement of an measuring instrument, these sensors manufacture totally different analog values supported positions of those sensors. the various gestures ar allotted distinctive numbers to spot a selected gesture. Once a gesture is known, it's being displayed on LCD and also the same is transmitted via wireless transceiver. Using a comparison technique at the receiver aspect of the system, for every worth that's received, the microcontroller outputs gesture specific commands to LCD module at the receiver and to the Voice IC at the same time for giving the speech signal and text consequently.

The following table provides the various ADC values of every sensing element for various gestures.

Future Scope

Thus the gesture recognition system designed victimisation detector fusion and gesture recognition techniques during this venture includes a ton of future aspects that must be taken into thought so as to support the assistance for this otherwise abled folks a lot of. This sensible glove pronto banishes the specified interpretation between a speech impaired and a traditional person. Future implementation is created by enhancing the standard of the mobile application which may be wont to manufacture loads of technical quality analysis as in what's to be enforced to help them a lot of. It is enforced in varied fields like in aerodrome and railway stations to help the speech impaired. an added technical issue is handled is to help multi-gesture at the next speed during which from time to time this device accuracy fails to achieve the height. Keeping in mind the top goal to boost and encourage the a lot of signal acknowledgment, movement handling unit is introduced.

Conclusion

This system is helpful for dumb, deaf and blind folks to speak with each other and with the conventional folks. The dumb folks use their customary linguistic communication that isn't simply intelligible by {common folks|folk|people} and blind people cannot see their gestures. this method converts the linguistic communication into voice that is definitely intelligible by blind and traditional folks. The linguistic communication is translated into some text type, to facilitate the deaf folks yet. This text is show on digital display. so as to boost and facilitate the a lot of gesture recognition, motion process unit is put in that contains of gyro yet and with the assistance sensing element fusion technique, we are able to accommodate variety of different gestures yet for higher and economical communication. Sign language could be a methodology used for communication by disabled person. Here we have a tendency to ar changing linguistic communication into text and speech so communication isn't restricted between them solely, utilizing information gloves communication barrier between 2 completely different communities is eliminated. exploitation information gloves disabled person may also grow in their carrier and makes nation grow as share of disabled person ar millions in count. creating their future higher ,making nation higher.

References

Get the App