Sign Language language To Speech Conversion

Sign Language To Speech Conversion

flex sensor interfacing with arduino

Prateek 31/10/2022

4 8,606 4 minutes read

Table of Contents

Introduction

Communicating through hand gestures is one of the most common forms of non-verbal and visual communication adopted by speech-impaired populations all around the world. The problem existing at the moment is that most people are not able to comprehend hand gestures or convert them to enough for the listener to understand.

A large fraction of India’s population is speech impaired. In addition to this communication to sign language is not a very easy task. This problem demands a better solution that can assist the speech-impaired population in conversation without any difficulties. As a result, it reduces the communication gap for the speech impaired.

Sign language is an essential form of communication for individuals with hearing impairments. However, it can be challenging for those who don’t understand sign language to communicate effectively with sign language users. To bridge this communication gap, we can use technology to convert sign language gestures into audible speech. In this article, we will explore how to build a sign language-to-speech conversion system using Arduino, a flex sensor, and a 16×2 LCD with I2C.

Basic Sign Language to Text Conversion

Bill of Materials

S.N	Components	Quantity	Link To Buy
1	Flex Sensor	5
2	Arduino Nano	1
3	DF Mini Player	1
4	Speaker	1
5	Zero PCB	1

Component Overview

Arduino Nano

In this Project, I used the Arduino Nano microcontroller because of its small size. Arduino Nano’s operating voltage is 5v and the flex Sensor operates at 5v that’s why I chose this microcontroller.

Here is the Pin Conviction of the Arduino Nano microcontroller. I used the 5 flex sensors and all sensors were given the output of Analog form Arduino Nano in Built 8 Analog pin (A0-A8).

Flex Sensor

A flex sensor is a resistive device that changes its resistance based on the amount of bending or flexing applied to it. It is usually made of a flexible material, such as a thin film or plastic, embedded with conductive material. As the sensor bends, the conductive material’s path changes, altering the resistance of the sensor.

Flex Sensor is used in various fields, like control Robot, Control Home Applications, and speech conversion.
Flex Sensor Has Two leads you see in the image and acts like a variable Resister.
The Flex Sensor Output of resistance changes In two pins, when the voltage changes across the leads the resistance will change.

The Flex Sensor operating voltage is 0-05v And the Sensor Flat resistance is 25Kohm

The flex sensor’s resistance varies in proportion to the angle of bending. When the sensor is in a relaxed or straight position, it exhibits a specific resistance value. As it bends, the resistance changes, allowing us to interpret the degree of bending.

Df Mini Player

The DF Mini Player is a module designed to play audio files from a microSD card. It supports various audio formats, including MP3, WAV, and WMA. The module incorporates a microSD card slot, a built-in amplifier, and a 3.5mm audio jack for connecting speakers or headphones. It also features a simple serial communication interface, making it compatible with Arduino and other microcontrollers.

DF mini is a Small Playback Music System, is provides alerts or Sounds When the MicroController gives the Command.
You Just Save the MP3 File On the SD Card And just put the DF Mini But which name or number do you put on the SD card same name or number Given To The Code?
Df Mini is Supported by the UART Connection.

Df mini operating voltage is 3.5v to 5v you just Connect the VCC to Arduino 5v and GND Will connect to the GND.
Rx Pin Will be Connected to the Arduino D10 PIN And the Tx Pin Will be Connected To the Arduino nano D9 PIN.

Key Features and Functionality

Audio File Playback: The DF Mini Player can play audio files stored on a microSD card. It supports a wide range of audio formats, allowing for versatile audio playback options.

Volume Control: The module provides volume control functionality, allowing you to adjust the audio output to the desired level.

Built-in Amplifier: The DF Mini Player includes a built-in amplifier, enabling direct connection to speakers or headphones without requiring additional external amplification.

Serial Communication Interface: The module communicates with the Arduino or microcontroller using a simple serial protocol. This makes it easy to control and trigger audio playback from the Arduino code.

Easy Integration: The DF Mini Player is designed to be easily integrated into Arduino projects. It requires minimal wiring and can be powered directly from the Arduino’s 5V supply.

Speaker

In this Project, I used the 8 Ohm / 0.25 watt Speaker and the sound of the speaker is relay clear and proper way sound.

Speaker

Zero PCB

In this Project I used the 4×4 zero PCB is Used to Build The Prototypes or Testing Of Any Project.
On the Back Side Of the Zero PCB, You Sold all the components.

Circuit Diagram

In this circuit Diagram, I will show the Proper Pin where I connected the All Sensor and modules with an Arduino Nano microcontroller.

Connect the +5V pin of the Arduino to the +5V pin of the Flex Sensor and DF Mini Player.
Connect the GND (ground) pin of the Arduino to the GND pins of the Flex Sensor and DF Mini Player.
Connect the analogue output pin (A0) of the Flex Sensor to the A0 pin of the Arduino.
Connect the digital pins D9 and D10 of the Arduino to the TX and RX pins of the DF Mini Player, respectively.
Connect the +5V and GND pins of the DF Mini Player to the +5V and GND pins of the Arduino.
Connect digital pins D2, D3, and D4 of the Arduino to the Blue, Green, and Red LEDs, respectively.
Connect the Speaker/Headphones to the audio output jack of the DF Mini Player.

Source Code

For Raw value In Serial Monitor

const int flexPin = A1;

void setup() {
  Serial.begin(9600);
}

void loop() {
  int flexValue;
  flexValue = analogRead(flexPin);
  Serial.print("sensor: ");
  Serial.println(flexValue);

  delay(20);
}

const int flexPin = A1;

void setup() {

Serial.begin(9600);

}

void loop() {

int flexValue;

flexValue = analogRead(flexPin);

Serial.print("sensor: ");

Serial.println(flexValue);

delay(20);

}

This Code Is Valid Only for 1 Flex sensor fist you connect 1 Flex sensor and take the reading in the serial monitor then you use more Flex sensors.

//Prateek
//wwww.prateeks.in
//www.justdoelectronics.com
//https://www.youtube.com/c/JustDoElectronics/videos

#include "SoftwareSerial.h"
#include "DFRobotDFPlayerMini.h" 
DFRobotDFPlayerMini myDFPlayer;
void printDetail(uint8_t type, int value);
unsigned int f;
SoftwareSerial mySoftwareSerial(9,10);

void setup()
{
  
  Serial.begin(9600);
  mySoftwareSerial.begin(9600);
  Serial.println();
  Serial.println(F("Initializing DFPlayer..."));

  if (!myDFPlayer.begin(mySoftwareSerial)) {
    Serial.println(F("Unable to begin:"));
    Serial.println(F("1.Please recheck the connection!"));
    Serial.println(F("2.Please insert the SD card!"));
    while (true);
  }
  Serial.println(F("DFPlayer Mini online."));
  myDFPlayer.volume(30);

}

void loop()
{
  f = analogRead(1);
  Serial.println(f);
  if (f > 320)                      
  {
    Serial.println("Please Give Me Water");
    myDFPlayer.play(1);
    delay(1000);
  }
  else if ((f < 320) && (f > 280))  
  {
    Serial.println("Please Give Me Food");
    myDFPlayer.play(2);
    delay(1000);
  }
  else if ((f < 200) && (f > 100))  
  {
    Serial.println("Give Me Water");
    myDFPlayer.play(3);
    delay(1000);
  }
  else                            
  {
    if (f > 100)

  }
  delay(50);
}

//Prateek

//wwww.prateeks.in

//www.justdoelectronics.com

//https://www.youtube.com/c/JustDoElectronics/videos

#include "SoftwareSerial.h"

#include "DFRobotDFPlayerMini.h"

DFRobotDFPlayerMini myDFPlayer;

void printDetail(uint8_t type, int value);

unsigned int f;

SoftwareSerial mySoftwareSerial(9,10);

void setup()

{

Serial.begin(9600);

mySoftwareSerial.begin(9600);

Serial.println();

Serial.println(F("Initializing DFPlayer..."));

if (!myDFPlayer.begin(mySoftwareSerial)) {

Serial.println(F("Unable to begin:"));

Serial.println(F("1.Please recheck the connection!"));

Serial.println(F("2.Please insert the SD card!"));

while (true);

}

Serial.println(F("DFPlayer Mini online."));

myDFPlayer.volume(30);

}

void loop()

{

f = analogRead(1);

Serial.println(f);

if (f > 320)

{

Serial.println("Please Give Me Water");

myDFPlayer.play(1);

delay(1000);

}

else if ((f < 320) && (f > 280))

{

Serial.println("Please Give Me Food");

myDFPlayer.play(2);

delay(1000);

}

else if ((f < 200) && (f > 100))

{

Serial.println("Give Me Water");

myDFPlayer.play(3);

delay(1000);

}

else

{

if (f > 100)

}

delay(50);

}

Project Demo

Now I solder all the components and assemble them in zero PCB.

Now you upload all mp3 sound to an SD card and put it in DF Player.

Video Tutorial

Conclusion

This system can help facilitate communication between sign language users and individuals who do not understand sign language. With further enhancements, such as the addition of machine learning algorithms, the system’s accuracy and vocabulary can be improved, providing a more comprehensive sign language translation solution.

More Arduino Tutorial

4 Comments

Abinav vs says:

01/11/2023 at 10:23 pm

Can we use the code given below for both arduino uno and nano please reply its urgent
Prateek says:

04/11/2023 at 11:28 pm

Yes
nikhil says:

28/11/2023 at 3:34 pm

where is the audio for the project ?
Pingback: Sign Language To Text Conversion Using Flex Sensor

Introduction

Bill of Materials

Component Overview

Arduino Nano

Flex Sensor

Df Mini Player

Speaker

Zero PCB

Circuit Diagram

Source Code

Project Demo

Video Tutorial

Conclusion

Prateek

30+ DIY Projects Using Arduino Nano Development Boards

GSM Based Water Level Monitoring System Using Arduino

4 Comments

Leave a Reply

Related Articles

Home automation using arduino and bluetooth

Vehicle Accident Alert System Using Accelerometer

How To Make A DIY Arduino Joystick Control Car

Flex Sensor Interfacing With Arduino