Percutaneous liver biopsy is a reliable method used for the diagnosis and follow-up of many liver diseases. Although it is safe, major complications, such as free intraperitoneal bleeding, hemothorax, pneumothorax, hemobilia, and Pseudoaneurysm, have rarely been reported to be related to the procedure. The reported rate of hemobilia after performing percutaneous liver biopsy is approximately 0.06%. This event usually results from a hepatic artery pseudoaneurysm and can potentially cause fatal bleeding. In addition, acute cholecystitis and pancreatitis are rare complications of hemobilia. To the best of our knowledge, we report the third case of a patient who developed hemobilia, acute cholecystitis, and acute pancreatitis from a pseudoaneurysm after performing percutaneous liver biopsy. The bleeding was successfully controlled by angiographic embolization with glue and lipidiol.