Reinforcement Learning to teach robots Table Tennis

For Australian players looking for up-to-date platforms with fast withdrawals, it’s worth checking out the best new online casino sites Australia 2026 with real money pokies and PayID payouts. This guide breaks down the real terms offered by offshore operators, PayID transaction speeds, and how to tell a reliable platform from a mediocre one. It’s especially useful for anyone who wants to play for real money without waiting weeks for a payout.

Choosing the right deposit and withdrawal option can make or break your online casino experience, so it’s worth reviewing the best online casino payment methods for Aussies in 2026 before you sign up anywhere. This breakdown covers real processing speeds, hidden fees, and the offshore realities that Australian players need to understand. It’s a solid starting point for anyone who wants faster payouts and fewer surprises.

If you’re chasing bigger wins, it helps to know which titles actually deliver, so check out the best paying online pokies in Australia for 2026 before your next session. This guide highlights the machines with the highest RTP and most generous payout potential for Aussie players. It’s a handy reference for anyone who wants more value from every spin.

Before you commit to a new platform, it pays to compare what’s on the table, so start with this guide to the best welcome bonus online casino offers in Australia for 2026. It walks through sign-up promotions, wagering requirements, and the fine print most players overlook. A quick read here can mean the difference between a genuinely useful bonus and a wasted deposit.

For Aussie players who prefer a secure e-wallet over traditional banking, it’s worth exploring the casino sites that accept ecoPayz in Australia for 2026. This roundup covers platforms offering fast deposits, quick withdrawals, and solid bonuses for ecoPayz users. It’s a practical shortcut for anyone who values privacy and speed in their transactions.

Australian players who want to skip the guesswork can head straight to this guide to the best real money online casinos in Australia for 2026. It covers licensed offshore operators, banking options, and the key factors that separate trustworthy sites from risky ones. A useful read for anyone serious about playing for genuine cash rewards.

Prepaid payment options remain a popular choice for players who want to keep their banking details private, so it’s worth reviewing the casino sites that accept Paysafecard in Australia for 2026. This complete guide covers prepaid pokies, deposit limits, and how to cash out winnings from a voucher-based account. A handy resource for anyone who prefers top-up control over linking a card or bank account.

Players who value fast payouts and airtight security often turn to e-wallets, so it’s worth exploring the casino sites that accept Skrill in Australia for 2026. This guide breaks down e-wallet architecture, real payout speeds, and where to find genuine real money pokies. A smart starting point for anyone who wants deposits and withdrawals handled in minutes rather than days.

Finding a casino that supports your preferred banking method can save a lot of frustration later, so it’s worth checking out the casinos that accept MiFinity in Australia for 2026. This guide covers payment options, available pokies, and how withdrawals actually work for Aussie players. A practical read for anyone who wants a smooth, wallet-based casino experience.

Nobody likes waiting days for their winnings, so if speed matters to you, start with this guide to the best fast payout online casino in Australia for 2026. It compares withdrawal times across top platforms and highlights which ones actually pay out within hours. A must-read for players who want their cash without the usual delays.

PayID has quickly become one of the most convenient ways for Aussies to fund their casino accounts, so it’s worth reading this complete guide to new PayID pokies in Australia for 2026. It explains how to make fast, fee-free deposits and which platforms support the method properly. A great starting point for anyone who wants instant transfers without the usual banking headaches.

Getting your winnings quickly is one of the biggest priorities for any online player, so this complete pillar guide to a fast withdrawal casino in Australia for 2026 is well worth a look. It covers payout speeds, verification requirements, and the payment methods that actually deliver on their promises. An essential read for Aussies who don’t want to chase their cash for weeks.

If maximising your returns is the goal, it pays to know which platforms actually deliver, so dig into this definitive guide to the highest payout online casino in Australia for 2026. It breaks down real RTP figures, payout percentages, and how to spot operators that genuinely pay more. A valuable resource for players who want every dollar to work harder.

Not everyone wants to risk a large bankroll straight away, which is why this guide to a low deposit online casino in Australia for 2026 is worth a look. It covers small deposit options, PayID and crypto funding, and everything Aussies need to know before signing up. A smart read for players who want to start small without missing out on the fun.

Safety should always come first when real money is on the line, so it’s worth reviewing this breakdown of the most secure online casino in Australia for 2026. It covers technical safety audits, encryption standards, and the real money protocols that protect players. An essential read for anyone who wants peace of mind alongside their gameplay.

Reinforcement Learning to teach robots Table Tennis

Reinforcement Learning (RL), a subdiscipline of Machine Learning, is self-learning driven by the feedback of an agent’s actions to maximize reward in an environment. It concerns an agent learning a task in an environment through iterative trial-and-error actions, using the feedback from the actions to inform future actions to generate more reward and minimize punishment. Through more iterations, the agent learns to perform better, developing increasingly optimal policies for action.

Reinforcement Learning model framework

Let’s consider the Table Tennis (ping pong) structure below. The agent is the robot arm, the environment is the larger space within which the ball lands after being struck by the paddle, and the reward indicates how good of a move it is. The state is the current instance of the racket. The agent is punished for negative outcomes — missing the ball, it hitting the net, or the ball landing outside the table after being struck by the paddle.

Reinforcement Learning model framework

Dynamic tasks such as this are much harder for robots than humans. The main challenges associated with teaching robots Table Tennis are the quick reaction times needed to perceive the location of the ball, constant changes in the environment, precise motions required to land the ball at a particular reward-generating position, and highly accelerated motions that may be used in smash or rapid manoeuvres to hit the ball.

Pneumatic artificial muscles (PAMs) are used in constructing the arm which holds the racket. They are used to execute high-speed hitting motions while having the capabilities to decelerate the arm without exceeding the joint angle range. PAMs involve soft actuators, devices converting energy to motion, with high force sensitivity and high impact resistance such that the arm mechanically adapts to quick external forces. The pressure range can be adjusted in a PAM to decelerate the motion.

The robot learns how to smash from scratch — you don’t have to program it. This is done by favouring highly accelerated strikes, which are achieved by maximizing the velocity of the returned ball in the reward function. Using simulations, the robot can learn without interacting with physical balls.

To maximize the desired action — delivering the ball to the desired landing location with the highest velocity —it should be specified in the reward function which the agent strives to learn. First, the racket needs to hit the ball, and then the return impact must be optimized to fit the desired behaviour as specified in the reward function.

The reward function evaluates the trajectory of the ball, which is contingent on the landing spot and velocity of the ball. In it, the agent is penalized for the difference between the ball and the racket trajectory. So the agent is constantly motivated by the feedback it is given regarding how close the ball missed the racket. This directs the racket to be as closely positioned to the ball as it can when hitting the ball.

Reinforcement Learning model framework

In the mathematical denotation of the table tennis (tt) racket reward function, the difference between the desired and actual landing spot determines the reward an agent achieves. The normalization constant, c, aims to proportionately convert the reward values to between 0 and 1. The exponent, 3/4, is to introduce slight variance around the optimal value. This partly addresses the anomaly that may arise from the ball hitting the edge of the racket leading to unexpected results.

In the smash task, the reward involves maximization of the velocity denoted by b alongside the minimization of the difference between the desired and the true landing location. The high velocity of the smash comes with a compromise in the precision of landing, as also is the case with human players. In the smash task, the velocity averages ~12 m/s compared to velocity averages of ~5 m/s for the returned task.

The training starts with the agent’s random explorations of the space as a response to a simulation of the ball. It iteratively gets more attuned to the movements of the ball. It learns itself from scratch, epitomizing Reinforcement Learning. Curiously, it also picks up how to position the racket before the hit to prepare for the hit.

Reinforcement Learning model framework

Smashing is harder to learn than simply returning. This invites a larger exploration in the initially stochastic space. In the training simulations, it’s exploring more as it aims to maximize both components of the reward — high velocity and desired to land location — while also learning the trade-off between the two.

Both the tasks — returning and smashing — involve a little more than 14 hours of training. The training time is a result of the convergence of return rates. This means that the testing return and smash rate plateaued after several iterations or policy updates. After 183 policy updates (reflected on the x-axes below), updating was deemed futile.

Reinforcement Learning model framework

Remarkably, the agent can learn from software simulations of Table Tennis, and transfer the learning to real-world Table Tennis. When tested to return, the agent hits 96% of the balls with 75% of the total returning to the opponent’s side. When tested to smash, the racket hits the ball 77% of the time while only 29% of the tested balls making it to the opponent’s side.

Reinforcement Learning model framework

The researchers accomplish commendable accuracy rates with PAM robots. The intelligent system learns from scratch and trains without real balls. The system overcomes the problems associated with dynamic precision, accelerated motions, and immediate reactions.

This piece is a distilled overview of this paper. Find a YouTube video simplifying the study here.

Leave a comment

Your email address will not be published. Required fields are marked *