Are you only getting the happy face? Maybe you aren't really seeing much change because you aren't getting all that many points. The happy face is the lowest amount, followed by the music note, and then the heart which is the highest (500+).
If you really want points, play with EVERY pokemon you see. Then just leave the area and go back to the island until pokemon and items stop appearing. You want a heart to appear above your Pokemon, which means you got over 500 IIRC