We have developed a novel three dimensional tactile sensor based on vertically aligned carbon nanotubes. The carbon nanotubes were directly synthesized on silicon microstructures and these CNTs-on-microstructures were integrated to flexible polydimethylsiloxane layers. Each tactile sensor has four sensing parts and the direction of force can be detected by monitoring the increase or decrease of electrical resistance in each sensing part. High gauge factor up to 272 and fast response less than 10 ms have been experimentally verified from the presented tactile sensor. The deviated contact resistance change from the initial value was less than 3% after repeated force input of 15 mN for 180,000 cycles.