At 13:43 WIB we detected a spike of unauthorized IP errors and several customers have raised the same issue happening on their side. Upon investigation, we found out that Xendit APIs were temporarily disrupted for customers who have enabled IP Whitelist feature and confirmed that there was an issue. We immediately get our hands together to focus on system recovery, and all Xendit APIs resumed to normal operations at 13:54 WIB.
Our post-incident investigation revealed that the root cause happened during an effort to upgrade our reliability and traceability in one of our core services. During this process, the service’s NGINX web server configuration was changed during the deployment, causing IP information not being correctly passed to IP verification service. The configuration changes were made because the default port clashed with other services’ port and it needs to be adjusted to proceed the deployment
What measures have we taken to prevent this issue in future?
Action items we are taking to prevent issues from happening again in the future:
We know that you are counting on our reliability for the smooth operation of your business. We are truly sorry for the negative impact of this incident on your customers and your business. We are committed to learn from this event and to improve our services even further.
Please contact us at help@xendit.co or through live chat at https://www.xendit.co/ if you have any questions or require any assistance regarding this issue.
We will strive to continue improving our services everyday and do our best to prevent this incident to reoccur. Thank you for your trust in using Xendit to power your business.