Most first time travelers to Japan will end up visiting Kyoto and/or Osaka. They are both very different cities with their own distinct vibe. If you have time constraints that prevent you from spending a few days in each city, know that it takes less than an hour to travel between both by regular train. This makes it possible to visit both whilst being based in only one of the two cities.
