Elyashiv devoted his life to Torah study and credited his longevity to never getting angry. He rejected worldly possessions and chose instead to live modestly in a tiny Jerusalem apartment, where people lined up, seeking advice, blessings and rulings on religious issues.
The Shaare Zedek hospital in Jerusalem said Elyashiv died there after a long illness.
Elyashiv was the leader of the Lithuanian sect of ultra-Orthodox Ashkenazi Jews that adhere to a strict religious lifestyle and ideology renowned for its analytic form of studying complex Jewish holy texts.
He also served as the spiritual leader of a small ultra-Orthodox party in the Israeli parliament, Degel Hatorah, which later merged into the influential United Torah Judaism that consists of various small religious parties.
Party members conferred with Elyashiv on all matters - political, religious and personal - and a few words uttered by the elderly rabbi could sway Israeli policy or affect daily life for devout Jews.
For his hundreds of thousands of followers around the world, Elyashiv was considered a sage and a respected arbitrator of the intricacies of Jewish religious law and practices.
Tributes began pouring in shortly after news of his death was reported on Israeli TV and radio stations.
"In his rulings, Rabbi Elyashiv left a deep mark on the ultra-Orthodox world and on the entire people of Israel," Prime Minister Benjamin Netanyahu said in a statement. "The rabbi's way was that of love of the Torah and love of man, humility and the protection of the sanctity of life."
Israeli President Shimon Peres, the mayor of Jerusalem, the country's chief rabbi and many others also offered condolences.
Menachem Friedman, a professor emeritus of Bar Ilan University and an expert on ultra-Orthodox Judaism, called Elyashiv "an extraordinary scholar."
"He lived in great modesty in a small, rundown apartment, and people would flock there day and night seeking answers to complex questions of Jewish law and asking for blessings," Friedman said. "Often they would line up outside in the alley for hours just to catch a glimpse of the rabbi."
Friedman said Elyashiv was a kingmaker who worked behind the scenes to approve the appointment of Israel's chief Ashkenazi rabbis as well as Jerusalem's first ultra-Orthodox mayor, Uri Lupolianski, in 2003.
Elyashiv was unique in that his rulings transcended the divide among the different Jewish sects. His authority was accepted by all but the most fringe groups, Friedman said.
Elyashiv was born on 10 April 1910, to a rabbinical family in Lithuania. He moved at a young age to Jerusalem, where he grew up in the insular ultra-Orthodox neighborhood of Mea Shearim.
He served as a judge in the sensitive position of the rabbinical appeals court until 1974, when he retired. The rabbi then devoted his time to Talmudic scholarship, mainly in an otherwise abandoned building in Jerusalem, so he could study alone without interruption, Friedman said.
Elyashiv ruled on a wide range of issues.
He condemned a directive by a group of radical Israeli rabbis in 2010 forbidding renting or selling property to non-Jews. Elyashiv said those who supported the ruling should "have their pens taken away." Elyashiv's opinion prompted several rabbis who signed the edict to retract their signatures.
Elyashiv spoke out against Jews visiting the Jerusalem shrine they know as the Temple Mount, which was home to the Jewish temples in biblical times until destroyed by the Romans in 70 A.D.
He said Jews are not ritually pure enough to set foot on the sacred ground today, and that visits by Jews could lead to bloodshed, because the Al-Aqsa Mosque, Islam's third-holiest site, stands there now.
In another ruling, he banned ultra-Orthodox women, who cover their hair for modesty, from wearing Indian-made wigs in case the wig hair had previously been used in Indian worship, which would disqualify them for Jewish ritual. The edict prompted the burning of thousands of wigs in Israel as well as in Jewish communities in Brooklyn and elsewhere.
Elyashiv also made several proclamations that drew the ire of the mostly secular Israeli public.
He vehemently opposed ultra-Orthodox Jews serving in the Israeli military and opposed secular studies for his community, fearing outside influences could change their traditional way of life.
And he forbade Jews from wearing Crocs shoes on Yom Kippur, the Day of Atonement, because he said they were too comfortable for the somber atmosphere of the day of fasting and repentance.
Shortly before his death, the Israeli news website Ynet was granted rare access to film the two-room apartment where he raised his 12 children. The video showed humble living quarters consisting of a bed, a few pieces of basic furniture and vast amounts of books.
"He wakes up about 3:30 in the morning, studies for a few hours and then leaves at 6:00 for prayers at a small synagogue nearby," said Shlomo Kook, an aide to the rabbi.
"He told his students that the secret to his long life is never to get angry and never take things personally or to heart - except Torah study, which should be taken straight to the heart," Kook said.
The rabbi's health deteriorated in recent years, and he was hospitalized many times for lung infections and other ailments.
Thousands of Jews prayed for his recovery in recent weeks in synagogues around the world.
The rabbi had 12 children. One of them, a little girl, was killed in Jordanian shelling in 1948 during the battle for Jerusalem that followed Israel's creation, and another died at a young age from typhus.
The other 10 children had large families who in turn had many children of their own, putting the number of the rabbi's survivors at close to a thousand, Kook said.
According to Jewish tradition, the funeral takes place as soon as possible after a death, so the rabbi's funeral procession began late Wednesday night.
Israeli police said they would close roads in Jerusalem for the procession, which was expected to draw tens of thousands of people.