Do I need to keep my computer on while RClone is running?
Content:
I have RClone on my computer in order to move files from cloud storage to my seedbox (connected via SSH). I started the job and I thought that was it but I noticed if my PC goes to sleep, when I turn it back on the transfers are all failing. Is this because I need to keep Rclone running on my PC while the transfers are being done?
We are DataHoardingFreaks. A @roadtopetabyte project

Linux: Run rclone upon USB drive insertion?
Content:
Hi All,
Would like to start archiving important data from my Debian based NAS (OpenMediaVault). Wondering if anyone has anything similar to the following, and if so how they went about it?
Detect when a USB disk is inserted, mount it and then run an rclone script.
Span the archival process across multiple USB disks.
Appreciate any help.
We are DataHoardingFreaks. A @roadtopetabyte project

QNAP Releases 2-bay 2.5GbE NAS TS-216G, Offering Cost-Effective Smart Management and High-Speed Backup
Content: {
Taipei, Taiwan, March 18, 2024 - QNAP® Systems, Inc., a leading computing, networking, and storage solution innovator, today launc ...} More
Source: https://www.qnap.com/en/news/2024/qnap-releases-2-bay-2-5gbe-nas-ts-216g-offering-cost-effective-smart-management-and-high-speed-backup
Author: marketing@qnap.com (QNAP Systems, Inc.)
Date: March 18, 2024 at 04:01AM
We are DataHoardingFreaks. A @roadtopetabyte project

Need help with Easystore
Content:
My drive shows that it's 0 bytes, has the factory name "Easystore 2648" and I have tried multiple ways to format it. It is running, the light is on, and the computer thinks it's working properly. The drive is 1tb normally.
We are DataHoardingFreaks. A @roadtopetabyte project

Need help with Easystore
Content:
My drive shows that it's 0 bytes, has the factory name "Easystore 2648" and I have tried multiple ways to format it. It is running, the light is on, and the computer thinks it's working properly. The drive is 1tb normally.
We are DataHoardingFreaks. A @roadtopetabyte project

QNAP TS-216G: NAS für private Cloud und Backup mit 2,5 GbE
Content: MediaMit der TS-216G stellt QNAP ein neues NAS-System für bis zu zwei Laufwerke vor, das kostengünstig als persönlicher Cloud-Speicher und Backup-Lösung mit 2,5 Gigabit schnellem LAN aufwarten soll. Einen Preis nennt QNAP zur Ankündigung allerdings noch nicht.
Source: https://www.computerbase.de/2024-03/qnap-ts-216g-nas-fuer-private-cloud-und-backup-mit-2-5-gbe/
Author: Frank Hüber
Date: March 19, 2024 at 10:55AM
We are DataHoardingFreaks. A @roadtopetabyte project

Fallende Preise?: Kioxia und WD produzieren wieder mehr NAND-Flash
Content: MediaDie Hersteller hatten ihre Produktion von NAND-Flash zurückgefahren, um hohe Lagerbestände abzubauen und den Preisverfall zu stoppen. Inzwischen sind die Preise deutlich gestiegen und die Lager leerer geworden. Daher wollen Kioxia und Western Digital ihre Produktion wieder weiter hochfahren.
Source: https://www.computerbase.de/2024-03/fallende-preise-kioxia-und-wd-produzieren-wieder-mehr-nand-flash/
Author: Michael Günsch
Date: March 19, 2024 at 08:46PM
We are DataHoardingFreaks. A @roadtopetabyte project

SK Hynix PCB01 alias P51: Endlich kommt eine Alternative zum Phison E26
Content: MediaUnter dem Namen PCB01 präsentiert SK Hynix das Design einer schnellen M.2-SSD mit PCIe 5.0 und Transferraten von bis zu 14 GB/s lesend und 12 GB/s schreibend. Bestückt mit einem hauseigenen Controller und TLC-Speicher der achten Generation soll die Technik als Platinum P51 SSD für Endkunden eingeführt werden.
Source: https://www.computerbase.de/2024-03/sk-hynix-pcb01-alias-p51-endlich-kommt-eine-alternative-zum-phison-e26/
Author: Michael Günsch
Date: March 20, 2024 at 07:16PM
We are DataHoardingFreaks. A @roadtopetabyte project

Files shortcut
Content:
Hello guys.
i have 2 remotes A & B. A is 8 TBs and B is only 25 GBs. and a middle server which i use for running rclone.
i want to show remote A files in B.I can't copy files which is obvious because of size. was thinking is there any way to list file names on B and when i click on it, it used middle server to copy file from A to B on demand ?
it is possible ?
thanks.
We are DataHoardingFreaks. A @roadtopetabyte project

PD20M Mag Portable: Externe SSD hält sich magnetisch am iPhone fest
Content: MediaSchlanke SSDs, die sich magnetisch an einem Smartphone befestigen lassen, sind ein neuer Trend. Nach Lexar präsentiert Team Group ein solches Modell. Die PD20M Mag Portable SSD liefert 1 TB oder 2 TB Speicherplatz in einem 8,2 mm flachen Gehäuse. Via USB 3.2 Gen 2×2 werden lesend wie schreibend 2.000 MB/s versprochen.
Source: https://www.computerbase.de/2024-03/pd20m-mag-portable-externe-ssd-haelt-sich-magnetisch-am-iphone-fest/
Author: Michael Günsch
Date: March 21, 2024 at 08:54PM
We are DataHoardingFreaks. A @roadtopetabyte project

Google Drive + rclone + kate editor problems
Content:
Has anybody else seen odd things when using KDE's kate editor to open Google Drive files mounted via rclone/fuse?
If I try to open a file mounted that way and the current directory is NOT on Google Drive, it opens fine.
If the current directory is a Google Drive mount, kate simply doesn't start. No errors, nothing.
The same thing happens at the command line and from the Dolphin file browser (right click then "Open with Kate").
I suspect kate is trying to write something to the current directory that Google doesn't like, but I haven't figured out what.
I tried changing kate's swap location from the current directory to /tmp, but that doesn't seem to affect it (unexpectedly).
Here's how I'm mounting the Google Drive remotes:
mount_rclone_remote() {
local mount_point="$1"
​
# Expand tilde to the home directory
mount_point=$(eval echo "$mount_point")
​
# Extract the remote name from the last part of the mount point
local remote_name="${mount_point##*/}"
​
# If remote names in rclone.conf have spaces, do not replace them with underscores
# remote_name="${remote_name// /_}"
​
# Check if already mounted
if mount | grep -q " ${mount_point} "; then
echo "WARNING: Remote '${remote_name}' is already mounted at ${mount_point}. Nothing done."
return 0
fi
​
# Create the directory
mkdir -p "${mount_point}"
​
echo Mounting remote \"${remote_name}\" at \"${mount_point}\"
​
# Mount using rclone with the extracted remote name
rclone mount "${remote_name}": "${mount_point}" --daemon \
--vfs-cache-mode full \
--vfs-read-ahead 128M \
--buffer-size 64M \
--drive-chunk-size 128M \
--drive-acknowledge-abuse \
--cache-dir "/home/dave/.cache/rclone/${remote_name}"
}
dave@DARKHELMET:~$ rclone --version
rclone v1.65.2
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 6.5.0-14-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.6
- go/linking: static
- go/tags: none
​
We are DataHoardingFreaks. A @roadtopetabyte project

YingRen YRS820: Neuer SSD-Controller aus China zeigt seine Muskeln
Content: MediaIn Sachen SSD-Controller holt China immer weiter auf. Jetzt wurde ein neues Modell mit PCIe 5.0 angekündigt. Der YRS820 stammt von YingRen, die Firma ist hierzulande besser unter dem Namen InnoGrit bekannt. In Benchmarks wurden über 14 GB/s beim Lesen und 12 GB/s beim Schreiben erreicht. Er soll ohne Lüfter auskommen.
Source: https://www.computerbase.de/2024-03/yingren-yrs820-neuer-ssd-controller-aus-china-zeigt-seine-muskeln/
Author: Michael Günsch
Date: March 22, 2024 at 07:10PM
We are DataHoardingFreaks. A @roadtopetabyte project

Maximum download speed from rclone ?
Content:
I have a lot of folders with a lot of small files in each folder (text files and PDF files) on my putio directory, I’ve been using rclone to download them to my local machine. I noticed that the maximum download speed I’m getting is 3Mb/s. Is this kind of the expected download speed or is there something I can look into to increase the download speed? Maybe if there was a way to compress files before download or during download?
We are DataHoardingFreaks. A @roadtopetabyte project

Simple encrypted fileserver that you should enter the password every time
Content:
I'm using a Proxmox LXC as a webdav fileserver. I wanted it to be secure, so I wanted to apply my password every time I needed to mount the directory. The storage works on a 5x 2TB Seagate portable HDDs in RAID-6, and it the configuration pulls about ~250MBps at max.
By this, you can
discard HDDs easily without concerning privacy
prevent off-line breach, by simply shutting down the machine
rclone is all you need
without installing complicated cloud solutions (nextcloud, sftpgo, ...).
If you guys have any suggestions about the mount configuration, please don't hesitate to feedback.
All scripts used:
Provider cli options (fileserver)

rclone --cache-dir=/cache \
 --cache-chunk-total-size=200Gi \
 serve webdav /hdd \
 --addr=:8080 \
 --vfs-disk-space-total-size=5000Gi \
 --vfs-cache-mode=full

Consumer rclone config

$ cat rclone.conf
[webdav]
type = webdav
url = http://x.x.x.x:8080
vendor = rclone
[crypt]
type = crypt
remote = webdav:/
password = REDACTED # the obscured version by rclone

Consumer mount script

$ cat mount.sh
#!/bin/bash
predefined_hashed_password=REDACTED # simply hard-code the sha256sum of the password. You can add some salt but whatever - this script will stay on my local server
# Prompt for password input without displaying it on the monitor
read -s -p "Enter password: " password
echo
entered_hashed_password=$(echo -n "$password" | sha256sum | cut -d ' ' -f1)
if [[ $entered_hashed_password == $predefined_hashed_password ]]; then
 echo "Password is correct. Mounting..."
 # Obscure the password using rclone command and store it as RCLONE_CRYPT_PASSWORD2
 export RCLONE_CRYPT_PASSWORD2=$(rclone obscure "$password")
 echo "Mounting"
 # Execute rclone mount for crypt
 rclone mount --vfs-cache-mode full \
 --poll-interval 10s \
 --vfs-write-back 5s \
 --buffer-size 256M \
 --vfs-read-chunk-size 128M \
 --vfs-read-chunk-size-limit off \
 --cache-dir /cache \
 --cache-chunk-size 10M \
 --vfs-cache-max-size 100G \
 crypt:/ /mnt/video_rclone
else
 echo "Incorrect password. Aborting..."
fi

We are DataHoardingFreaks. A @roadtopetabyte project

World Backup Day: Toshiba Encourages People to Backup Their Data Regularly
Content:
Media
Canvio Flex smart storage drive simplifies the backup of mobile devices, even on the go
Düsseldorf, Germany, 21 March 2024 – Toshiba Electronics Europe GmbH (Toshiba) emphasises the importance of this year’s World Backup Day on 31 March, the day to prevent data loss. This independent initiative responds directly to concerns about data loss on devices like laptops and smartphones and raises awareness about the value of backups and data preservation. Toshiba’s Canvio Flex external hard disk drive makes mobile device backups even more accessible by allowing users to make copies of important files directly from their smartphone – without needing a laptop or PC.
According to research undertaken by numerous groups, only a tiny percentage of people make frequent backups of their digital data. Even more concerning is that a significant section of our continually data-generating society never backs up, leaving them vulnerable to substantial data loss dangers. An independent survey conducted by Acronis, a world leader in cyber protection, reveals that 41% of all individual users rarely or never back up their computers or mobile devices. According to the most recent report, 72% of all users had to recover from backup at least once that year, implying that some users who did not back up had permanently lost data.
As Larry Martinez-Palomo, Vice President, Head of Storage Products Division, explains: “In a world that is becoming increasingly digital, the need for flexible storage solutions is growing. Photos, videos, and important documents accumulate on our devices – especially smartphones. World Backup Day helps raise awareness of the importance of backing up these files more regularly. The Toshiba Canvio Flex external hard drive makes backups easy – connect the USB cord to your smartphone or other device and drag and drop to secure the future of your digital files and memories.”
A backup plan is one of the most critical strategies to preserve and keep data safe. Backing up ensures that even if the device slips into the wrong hands, a backup of the most important files is retained, secure, and easily accessible. The Toshiba Canvio Flex works interchangeably with most major device platforms and operating systems. Preformatted for Macs, Windows PCs, smartphones, and tablets*, this drive allows seamless access to data, and sharing between devices.
* Please check out the Canvio Flex compatibility list: https://www.canvio.jp/en/compati/hdd/ot_ehdd/flex/index.htm
Please download the Press Release here.
Source: https://www.toshiba-storage.com/about/press-center/world-backup-day-toshiba-encourages-people-to-backup-their-data-regularly/
Author: mtheissen
Date: March 25, 2024 at 12:28PM
We are DataHoardingFreaks. A @roadtopetabyte project

File path contains whitespace in rcloneBrowser (Fork)
Content:
I have problem with rcloneBrowser (I know this not official but I don't know where I should ask)
I using --filter-from <path> to filter dirs. but I can't add path with whitespace, it show error...
can someone help me to bypass whitespace path in rclonebrowser?
P.S I tried to hover path with ' and " but it doesn't worked in RcloneBrowser. (it working fine if I using cmd command as normal way...)
We are DataHoardingFreaks. A @roadtopetabyte project

How to periodically download shared cloud folder
Content:
Hello,
I have some mega.nz/box.com/other_clouds links of shared folders that I would like to download locally, and if possible regularly update the local directory with the changes on the cloud folders. I think rclone would be ideal for that but I'm completely lost. If you have an example it would be great.
thanks !
We are DataHoardingFreaks. A @roadtopetabyte project

Will Offcloud be supported by rclone?
Content:
I've seen that 3 debrid services are already supported. Does anybody know if/when offcloud support will be reality?
Alternatively, do you know if there's a way to mount OC even if there is no specific remote for it?
We are DataHoardingFreaks. A @roadtopetabyte project