You are absolutely correct!
I just re-read chapter 7 and noticed how Darcy, when he ran into Elizabeth at Pemberly, was definitely evasive when he hesitantly said that he had just dealt with business elsewhere, and also about Colonel Fitzwilliam's whereabouts. Later, he mentions to Bingley that he has "reasons to believe" that the Bennets are not up to hosting visitor/ right now, and then, there was this whole paragraph of Darcy's internal thought, in italic no less, which I somehow comlpetely missed?!? It should have bitten me in the nose, and yet my eyes apparently just jumped over this paragraph - LOL :-D
"Tomorrow will be an interesting day, he thought. Although our time is short, I know as soon as Elizabeth and the Gardiners find out about Lydia, they will whisk Elizabeth away to Hertfordshire. I am sure by her pleasant countenance this morning and afternoon, Miss Bennet is still unaware. Surely she is. After all, she mentioned to Bingley that Lydia was still in Brighton. Surely she would not say that if she was aware of her cousin’s return to Hertfordshire. But I will not worry about it. Tomorrow, I will enjoy her company until I have lost it again. Then when Bingley returns to Netherfield, so will I."