No, it is not hard to invite all your family to visit you in Australia on a visitor visa. You can invite them through Sponsored Family Stream.
Sponsored Family Stream allows a stay of three months which can extend up to 12 months in certain circumstances. This visa generally allows a single entry in Australia.
As a Sponsor,
As a visa applicant,
Also, the sponsor has to make sure that the family visiting is solely coming on travel/leisure purpose and have no intention to settle in the country and will leave the country after the fixed time period.
Your sponsor may to have pay a security bond (usually between $5000 and $15000 which will be refunded only after you comply with the visa conditions and leave Australia before your visa expires.