To apply job in Japan, you need Japanese Resume and CV. Ususally we use Cover Letter and CV to apply a job, in Japan usually templates for Resume and CV are fixed. Are you familiar with this resumes? Here is some brief explanation about this resumes.
Japanese Resume (履歴書：Rirekisho): Document that conveys your background (education, work experience) and basic information (name, date of birth, contact information, etc.)
If your question is can we living in Japan without Japanese skill. The answer is yes.
You can get a job without needing Japanese. But unfortunately as Japanese are not really familiar with English (compare with other Asian countries) I can say your opportunities to work in Japan with zero Japanese language is limited.
I am Indonesian, living and working in Japan for almost 7 years. After the Corona spread, it`s almost 3 years I`m not back to my home country. Besides the situation in Indonesia due to Covid-19 was really bad, the number of quarantines for 7 to 14 days made me think twice to fly home. As an ordinary office worker, I have to use my paid leave if I go to Indonesia. And taking paid leave for quarantine doesn't seem like a wise choice for me.