AI

What Happens When AI Writes the Wrong References?

HKU professor apologizes after PhD student’s AI-assisted paper cites fabricated sources.

Updated

November 28, 2025 4:18 PM

The University of Hong Kong in Pok Fu Lam, Hong Kong Island. PHOTO: ADOBE STOCK

It’s no surprise that artificial intelligence, while remarkably capable, can also go astray—spinning convincing but entirely fabricated narratives. From politics to academia, AI’s “hallucinations” have repeatedly shown how powerful technology can go off-script when left unchecked.

Take Grok-2, for instance. In July 2024, the chatbot misled users about ballot deadlines in several U.S. states, just days after President Joe Biden dropped his re-election bid against former President Donald Trump. A year earlier, a U.S. lawyer found himself in court for relying on ChatGPT to draft a legal brief—only to discover that the AI tool had invented entire cases, citations and judicial opinions. And now, the academic world has its own cautionary tale.

Recently, a journal paper from the Department of Social Work and Social Administration at the University of Hong Kong was found to contain fabricated citations—sources apparently created by AI. The paper, titled “Forty Years of Fertility Transition in Hong Kong,” analyzed the decline in Hong Kong’s fertility rate over the past four decades. Authored by doctoral student Yiming Bai, along with Yip Siu-fai, Vice Dean of the Faculty of Social Sciences and other university officials, the study identified falling marriage rates as a key driver behind the city’s shrinking birth rate. The authors recommended structural reforms to make Hong Kong’s social and work environment more family-friendly.

But the credibility of the paper came into question when inconsistencies surfaced among its references. Out of 61 cited works, some included DOI (Digital Object Identifier) links that led to dead ends, displaying “DOI Not Found.” Others claimed to originate from academic journals, yet searches yielded no such publications.

Speaking to HK01, Yip acknowledged that his student had used AI tools to organize the citations but failed to verify the accuracy of the generated references. “As the corresponding author, I bear responsibility”, Yip said, apologizing for the damage caused to the University of Hong Kong and the journal’s reputation. He clarified that the paper itself had undergone two rounds of verification and that its content was not fabricated—only the citations had been mishandled.

Yip has since contacted the journal’s editor, who accepted his explanation and agreed to re-upload a corrected version in the coming days. A formal notice addressing the issue will also be released. Yip said he would personally review each citation “piece by piece” to ensure no errors remain.

As for the student involved, Yip described her as a diligent and high-performing researcher who made an honest mistake in her first attempt at using AI for academic assistance. Rather than penalize her, Yip chose a more constructive approach, urging her to take a course on how to use AI tools responsibly in academic research.

Ultimately, in an age where generative AI can produce everything from essays to legal arguments, there are two lessons to take away from this episode. First, AI is a powerful assistant, but only that. The final judgment must always rest with us. No matter how seamless the output seems, cross-checking and verifying information remain essential. Second, as AI becomes integral to academic and professional life, institutions must equip students and employees with the skills to use it responsibly. Training and mentorship are no longer optional; they’re the foundation for using AI to enhance, not undermine, human work.

Because in this age of intelligent machines, staying relevant isn’t about replacing human judgment with AI, it’s about learning how to work alongside it.

Keep Reading

Funding

Rokid Sets a Crowdfunding Record in Taiwan with NT$62 Million AI Glasses Campaign

From pre-orders to market entry, Rokid’s Taiwan campaign reflects how AI hardware is being introduced to consumers today.

Updated

December 17, 2025 1:43 PM

Rokid Glasses, a pair of AR glasses from Rokid. PHOTO: ROKID

Rokid has reached a significant crowdfunding milestone in Taiwan. Its Rokid Glasses campaign surpassed NT$62 million in pre-order funding on zeczec, Taiwan’s creative-oriented crowdfunding platform. The campaign ranked No. 1 across all categories on the platform in 2025 and entered the Top 10 funded campaigns in zeczec’s history, setting new records for AI and XR-related projects.

The campaign launched on October 28 and became one of the platform’s most prominent technology initiatives of the year. According to the company, the outcome followed growing visibility for Rokid Glasses after product showcases in New York, Berlin, Singapore and Paris, positioning the Taiwan campaign within a broader international rollout.

The crowdfunding achievement coincided with Rokid’s official market entry in Taiwan. On December 10, the company debuted Rokid Glasses locally, introducing the product to media, partners and early users in the region. The Taiwan launch mirrored earlier international events and connected the online crowdfunding campaign with a physical market presence.

Rokid Glasses combine augmented reality displays with built-in AI functions, including real-time multilingual translation, live transcription, navigation, object recognition and voice assistance. These capabilities were central to how the product was presented during both the crowdfunding campaign and the Taiwan launch, without framing the project as a traditional consumer electronics release.

The Taiwan campaign builds on Rokid’s prior crowdfunding history. The company previously raised more than US$4 million on Kickstarter, where Rokid Glasses became the highest-funded XR wearable project on the platform. The zeczec campaign extends that track record into one of Asia’s most established consumer electronics markets.

“Taiwan has one of the world's most mature and discerning consumer electronics markets”, said Said Justo Chang, Head of Global Channels at Rokid. “Reaching the top of Taiwan's crowdfunding platform is a great commercial achievement. We are excited to finally introduce Rokid Glasses to Taiwan”.

More broadly, the campaign highlights how crowdfunding platforms continue to function as launch and distribution channels for emerging AI and XR hardware. In Rokid’s case, product rollout, market entry and public participation converged within a single campaign, marking a notable moment for AI-enabled wearables in Taiwan’s technology landscape.