The brothers told the man to get into a car to go to another address and, while in the vehicle, Sokol Rranci threatened him with what appeared to be a handgun, the court heard.
They stopped at a BP petrol station in Mansfield, where the man managed to escape and the brothers drove off, he said.
The man told someone behind the till that he needed the police, the jury heard.
This employee later told police he could see “how frightened he was”, Mr Smart said.
He said police searched the Mansfield property and found the first “cannabis grow”.
A further 13 cannabis farms were also discovered in Barnsley, Doncaster, Hull, Scunthorpe in Lincolnshire, Worksop in Nottinghamshire and Withernsea in East Yorkshire.
Mr Smart said the largest of these, at Sculcoates Lane, Hull, had a yield worth about £1m.
When police went to arrest Sokol Rranci at his Worksop property in March 2022, they discovered false ID documents and £25,000 in cash hidden behind a bath panel, Mr Smart said.
Amarildo Rranci, now of Ferry Road, Scunthorpe, was arrested at an address in Worsbrough, Barnsley, on the same day, the jury heard.
Both men deny arranging or facilitating travel of another person with a view to exploitation.
Sokol Rranci also denies a charge of possessing a firearm or imitation firearm with intent to cause fear of violence.
The trial continues.
Follow BBC Yorkshire on Facebook, external, Twitter, external and Instagram, external. Send your story ideas to yorkslincs.news@bbc.co.uk, external.
:max_bytes(150000):strip_icc()/sea-drip-coffee-makers-test-ratio-six-coffee-maker-wdickey-619-bef28a2dce1842a4ba395e6e034b3a9c.jpeg "The 10 Best Coffee Subscriptions of 2024")
