Its not clear if you're referring to the time you lived with or without immigrants in your speculation here.
One has to keep focus on the fact that immigrants are humans too. And that a local job is not owned in perpetuity by the local. Locals never paid for rights to local jobs any more than did a foreign worker. Both have equal rights to start work.
On the same point, employers and the state can in no way create jobs as we commonly hear stated by propagandists. People simply start working by free choice. All employers and the state can do is *block* people from starting to work, which clearly is a gross injustice yet happens regularly. This fallacy is based on the economic principle that wages are paid out of capital which is obviously absurd circular reasoning. Labour 'creates' capital a priori.
And of course if one desires the best quality of worker then higher wages must be offered, not lower. Higher wages deliver more productivity all else being equal so its a fallacy to say that reducing wages by importing cheaper labour makes an economy more productive. That will harm the economy.
The problem in the H1B mania is that all sides in the debate are using propaganda to make way. By selecting special classes of people for special treatment. When the correct and honest way would be to take the common stock of total wages possible under present conditions as the key data point.
And of course the evil dragon of taxation - Apophis - the God of Chaos. Jobs taxes are always paid by the employer not the employee as is commonly misunderstood. You cannot exclude the destruction caused by jobs taxes and expect not to end up with a paradox.