I suspect that you might be especially confused with the tongue-twisting phrase “argument is valid if the premise cannot be all true without the conclusion being true as well”.
Perhaps things can be illustrated by an example. Suppose I tell you, “You’ll never see me in the park on a Sunday”. This just means “If it’s a Sunday, you won’t see me in the park.” Now, suppose it is a Monday and we run into each other at the park. Have I broken my promise/claim? No. Although the conclusion is false (i.e. you did catch me in the park), the premises weren’t fulfilled: it’s a Monday, not a Sunday. So I haven’t broken my promise/claim.
The only way you could invalidate my claim is if you find me at the park on a Sunday. In other words, you can only invalidate my claim if the premises are true (i.e. it’s a Sunday), but the conclusion is false (i.e. you did see me in the park). This is what is meant when we say that an argument/claim is valid “if the premise cannot be all true without the conclusion being true as well”. It means we cannot have the following: the premises all true, but the conclusion false. My claim that “You’ll never see me in the park on a Sunday” will be valid so long as whenever it’s a Sunday (i.e. the premise is true) you don’t see me at the park (i.e. the conclusion is also true). However, I could be at the park on any other day of the week: that doesn’t invalidate my claim.