This post is divided into five parts; they are: • Naive Tokenization • Stemming and Lemmatization • Byte-Pair Encoding (BPE) • WordPiece • SentencePiece and Unigram The simplest form of tokenization splits text into tokens based on whitespace.
Using Quantized Models with Ollama for Application Development
Quantization is a frequently used strategy applied to production machine learning models, particularly large and complex ones, to make them lightweight by reducing the numerical precision of the model’s parameters (weights) — usually from 32-bit floating-point to lower representations like 8-bit integers.
A Gentle Introduction to SHAP for Tree-Based Models
Machine learning models have become increasingly sophisticated, but this complexity often comes at the cost of interpretability.
Word Embeddings in Language Models
This post is divided into three parts; they are: • Understanding Word Embeddings • Using Pretrained Word Embeddings • Training Word2Vec with Gensim • Training Word2Vec with PyTorch • Embeddings in Transformer Models Word embeddings represent words as dense vectors in a continuous space, where semantically similar words are positioned close to each other.
10 Python One-Liners That Will Simplify Feature Engineering
Feature engineering is a key process in most data analysis workflows, especially when constructing machine learning models.
ChatGPT-Maker OpenAI Expands Its Global AI For Impact Programme In India | Technology News
New Delhi: ChatGPT maker OpenAI on Tuesday announced the next phase of its global ‘AI for Impact Accelerator Programme’ in India, highlighting a year of support for mission-driven organisations using artificial intelligence to solve real-world social problems. As part of this initiative, 11 nonprofits will receive new API credits, bringing the total value of technical grants under this initiative to $150,000. OpenAI API credits function as a prepaid payment method which means instead of relying on monthly billing through a credit card, users can purchase credits in advance and use them as needed. This effort is now part of the broader ‘OpenAI Academy’, which aims to make AI more accessible, useful, and grounded in solving real challenges. Over the past year, Indian nonprofits supported through the programme have developed and deployed AI tools in critical sectors like healthcare, education, agriculture, disability inclusion, and gender equity — making a visible impact in underserved communities, according to the company. The programme is delivered in partnership with The Agency Fund, Tech4Dev, and Turn.io. It includes hands-on technical guidance, shared learning within a cohort, and early access to OpenAI’s tools. It also reflects OpenAI’s broader commitment to ensuring that AI benefits everyone, especially those in regions with fewer resources. As part of its support, OpenAI also hosted a workshop in India to showcase the capabilities of its latest AI models, helping these organisations design large-scale solutions. The initiative aligns closely with the ‘India AI Mission’, which aims to democratise access to AI, grow a strong ecosystem, and develop tech solutions tailored to India’s unique social and economic needs. The India cohort includes organisations tackling large-scale challenges with the help of AI. Pragya Misra, Policy and Partnerships Lead at OpenAI India, praised the Indian cohort for using AI in thoughtful and impactful ways. She said the organisations reflect the values of the India AI Mission and show how advanced technology can be used with empathy and creativity to solve tough problems. OpenAI plans to expand this initiative further in India, with new organizations expected to join the programme later this year. As it continues to grow its presence, OpenAI is shifting from just providing access to building real, on-the-ground impact — supporting practical, scalable, and human-centered AI solutions.
Tech Giant Sends Out Invites For Exclusive Preview On June 27; Check Expected Camera And Colour Options
Google Pixel 10 Series Launch: Google is likely to hold a ‘special event’ for the Pixel 10 series of smartphones, just days after The Android Show and Google I/O 2025, according to media reports. The Pixel 10 lineup is expected to include four devices: the regular Pixel 10, Pixel 10 Pro, Pixel 10 Pro XL, and Pixel 10 Pro Fold. During the special event, the tech giant is expected to launch its highly anticipated smartphones on August 13 at a ‘Made by Google’ event. However, fans won’t have to wait long, as the devices are expected to hit stores a week later, on August 20 reportedly. Google Invitation To Superfans Google has sent out invitations to Pixel Superfans to apply for a pre-launch Pixel Penthouse event, scheduled for June 27 in London. The invitation, shared by a publication, reveals that Superfans can apply to win one of 25 slots to attend the 1.5-hour-long event, enabling fans to experience the latest features and upgrades to Android 16 as well. The 1.5-hour session promises attendees hands-on access to unreleased Pixel hardware, Q&A interactions with Google employees, and Pixel-themed goodies reportedly. The last date to apply is June 4, and the winners are scheduled to be announced on June 11, as mentioned in the invite. However, the invitation doesn’t confirm which devices will be showcased. Historically, tech giant Google has unveiled its Pixel devices in October. However, it advanced the launch timeline last year for the Pixel 9 series, releasing it in August before Apple unveiled the iPhone 16 series. Google Pixel 10 Series: Expected Chipset And Colour Options Google’s upcoming Pixel 10 lineup is expected to be powered by the new Tensor G5 chipset. The standard Pixel 10 is rumored to launch in Blue, Limoncello (Yellow), Iris (Purple), and Obsidian (Black) color options. Meanwhile, the Pixel 10 Pro and Pixel 10 Pro XL may be offered in Green, Sterling (Grey), Porcelain (White), and Obsidian (Black) variants. However, rumors suggest that the Pixel 10 may feature a 48MP wide and a 13MP ultra-wide camera setup—similar to the Google Pixel 9a. This would be a downgrade from the 50MP and 48MP lenses found on the Pixel 9. Moreover, the Google Pixel 10 Pro and Pro XL are expected to retain the same 50MP + 48MP + 48MP triple-camera system seen on the current Pixel 9 Pro models.
OnePlus 13s India Launch Date Officially Confirmed; Could Debut With AI Features – Check Launch Date, Expected Specs, And Price
OnePlus 13s India Launch: Chinese smartphone brand OnePlus has officially confirmed the launch date of the OnePlus 13s smartphone in India. The device is set to debut on June 5 at 12 PM IST. The phone is positioned between the OnePlus 13R and OnePlus 13, the 13s aims to offer flagship-level features and a premium design at a more accessible price point. The smartphone is expected to arrive with the new OnePlus AI features and the Plus Key, and will be powered by the latest Qualcomm Snapdragon 8 Elite processor. It is likely a rebranded version of the OnePlus 13T, which launched in China last month. The OnePlus 13s will be available in three colour options: Black Velvet, Pink Satin, and Green Silk. The smartphone is also expected to run OxygenOS 15 based on Android 15, in line with other recent OnePlus releases. OnePlus 13s Specifications (Expected) The smartphone is expected to feature a 6.32-inch OLED display with a 1.5K resolution and a 120Hz refresh rate for smooth visuals. It will be powered by the latest Snapdragon 8 Elite chip and may house a large 6,260mAh battery with support for 90W fast charging. The device will measure 8.15mm in thickness and weigh approximately 185g. On the photography front, the rear camera setup is likely to include a 50MP IMX906 primary sensor with OIS and a 50MP 2x telephoto lens, while a 32MP front camera is confirmed for selfies. OnePlus is also introducing a suite of AI features with the 13s, including AI VoiceScribe, AI Translation, AI Search, AI Reframe, and AI Best Face 2.0. The smartphone will also incorporate one of the largest vapor chambers in OnePlus’ lineup, along with a unique cooling layer integrated into the back panel for improved thermal management. OnePlus 13s Price In India And Availability The device is expected to be priced at around Rs 55,000, positioning it neatly between the OnePlus 13R (Rs 42,999) and the OnePlus 13 (Rs 69,999). It will be available for purchase through Amazon, the official OnePlus website, and offline retail stores across India.
Meta To Launch Instagram App For Apple iPad Users After WhatsApp- What To Expect
Instagram App For Apple iPad: Instagram is likely to introduce a dedicated application for Apple iPads, as per media reports. Following the recent launch of WhatsApp for iPads, Meta-owned social media platform is actively developing and testing a native Instagram app for iPad, with a public release expected by the end of this year if all goes smoothly. The new development is recently confirmed by the Bloomberg’s Mark Gurman in the Q and A section of the weekly Power On newsletter. The app is also said to be in active testing among employees at the company’s campus. Notably, Instagram is currently available for the Apple tablet on the App Store. However, it is a zoomed-in version of the iPhone app, with the content appearing at the centre of the screen. Instagram For iPad: What To Expect Instagram’s iPad app is set to bring a more refined and optimized user experience, starting with enhanced display scaling that takes full advantage of the iPad’s larger screen and aspect ratio. The interface is expected to feature a cleaner, more intuitive layout tailored specifically for tablets. The native version is likely to support iPadOS features such as Split View, facilitating easier navigation and improved interaction while multitasking with other applications. Adding further, the exclusive layout options and interface modes could further elevate the app’s usability on iPad. For video lovers, the update promises smoother scrolling and improved video playback, delivering a more immersive, cinematic experience while watching Reels in full-screen mode. Furthermore, Instagram has significantly evolved, now supporting high-resolution images, widescreen videos, and longer-form content—features that are ideally suited for tablet browsing. The growing competition from platforms like YouTube Shorts and TikTok, which already offers a dedicated iPad app and continues to attract younger audiences, has likely pushed Instagram to step up and ensure its iPad users no longer feel overlooked. Currently, iPad users can only access Instagram through the iPhone version of the app, which is not optimised for the tablet interface.
Microsofts Notepad App Gets Latest Updates: Check Whats New
New Delhi: Microsoft’s Notepad app has got latest updates, a blog post by senior executive at Windows Inbox Apps Dave Grochocki has announced. Microsoft has introduced lightweight formatting in Notepad, providing additional flexibility for users to structure content across the files. “The experience supports Markdown style input and files for users who prefer to work directly with the lightweight markup language. To get started, use the new formatting toolbar to apply formatting as you type or to selected text, including bold and italic styling, hyperlinks, and support for simple lists and headings,” Grochocki wrote in the blog. If the user however wants to return to plain text, they can clear all formatting from the formatting toolbar or from the edit menu. Users can switch between formatted Markdown and Markdown syntax views in the view menu or by selecting the toggle button in the status bar at the bottom of the window. If users prefer, they can disable support for formatting entirely in app settings. A couple of days ago, Microsoft announced that users can write new content in Notepad using generative AI. “The new write feature helps you quickly draft text based on your prompt, making it easy to start from a blank page or build upon existing content with AI-powered assistance,” it said. To get started, place your cursor where you want to insert new text or select content you’d like to use as a reference. Then right-click and choose Write, select Write from the Copilot menu, or use the Ctrl + Q keyboard shortcut. Enter your instruction into the dialog and click Send. The AI-generated output will appear directly on the canvas. You can select Keep text to add it to your document or Discard it if it doesn’t fit your needs. You can also continue refining the output by entering follow-up prompts to evolve your draft further. If you prefer, you can disable AI features in app settings, Microsoft added.