The difficulty is nothing more than the total hashrate of the network divided by the number of miners that are mining on that same network . The more miners there are with more GPUs and ASICs the more the hashrate of the network will go up, and our gains will slowly go down.