[LBBS-33] net_imap: Add/standardize commands to modify or purge keywords

PHREAKSCRIPT-66
dahdi_vpmadt032_loader.o: unannotated intra-function call
ASTERISK-151
ast_tls_cert: Expiration days needs to be configurable
DAHLIN-12
oct612x, wct4xxp: Compilation failure on next kernel
LBBS-103
mod_webmail: Crash when FETCH fails after retry due to no messages returned
PHREAKSCRIPT-20
dsp.c: coin DSP patch breaks faxing
ASTERISK-148
sig_analog: fgccamamf inserting "A" at the end of dialed number
ASTERISK-82
app_queue: Allow queue strategy to be manipulated externally
SLACK-7
Add support for detecting messages posted via workflow
ASTERISK-122
res_pjsip_device_features: Excessive refcount on endpoint object
ASTERISK-149
sig_analog: Winks from dialplan don't propagate onto DAHDI channels
LBBS-102
mod_smtp_filter: Received header no longer has 'for' recipient included
LBBS-80
mod_mimeparse: Occasional segfault when running tests
LBBS-98
net_smtp: Fix message processing actions being skipped in some cases
LBBS-86
Deadlock on internal lock mutex
PHREAKNET-54
Fix trunking to Telstar
DAHTOOL-5
Disabling span auto-assignment implodes kernel
LBBS-104
net_ssh: Attempt to resize node dimensions after node destroyed
PHREAKSCRIPT-71
Add PolycomPush application
PHREAKSCRIPT-36
app_audichron: Tone not working after announcements
PHREAKNET-6
Verification flags international calls
PHREAKSCRIPT-56
DAHDI Tools: Apply unmerged patches
ASTERISK-124
app_mixmonitor: Allow cancelling in-progress recording/recipients
DAHTOOL-4
dahdi_genconf: Hangs when run initially after span assignment
PHREAKSCRIPT-67
Add rate limiting application
ASTERISK-93
chan_dahdi: DSP optimizations
LBBS-31
mod_sieve: Major Sieve filtering overhaul and improvements
PHREAKNET-34
Pat Fleet prompts
LBBS-16
io_compress: Occasional memory corruption on shutdown
CAMI-1
Action Originate Returns -1
LBBS-13
pty.c: Attempt to acquire node lock after it's been destroyed
PHREAKSCRIPT-53
app_george: Cancel in-progress recording if nobody said anything
ASTERISK-142
res_pjsip_caller_id: P-Charge-Info should be used for ANI
ASTERISK-146
res_agi: callingani2 is not formatted as 2 digits
DOCS-3
verify.conf: Boilerplate uses hardcoded paths for astkeydir
LBBS-96
pty: CR NUL is sometimes split up, leaking to flaky test
ASTERISK-100
chan_dahdi: PRI lock held at module unload
ASTERISK-143
func_sysinfo: Add options to retrieve current verbose/debug levels
ASTERISK-150
func_curl: Add CURLOPT option to allow digest auth
ASTERISK-109
voicemail.conf.sample: Clarify misnamed option behavior
WSSMAIL-3
Message listing missing recipient for some messages
ASTERISK-137
sig_analog: Add alternate dial pulse scheme support
LBBS-65
net_smtp: Allow internal trusted hosts to be exempt from protocol violation checks
ASTERISK-102
app_voicemail: Play RDNIS if present when listening to envelope
DAHLIN-4
Improve manual span assignment process
ASTERISK-81
format_lame: MP3 read and write with LAME library
ASTERISK-20
app_meetme: Update or remove removal version
ASTERISK-23
logging: Update log levels
ASTERISK-59
chan_dahdi: Remove stripmsd
ASTERISK-49
Remove all deprecated stuff
ASTERISK-68
res_pjsip_sca: Segfaults on startup with SCA
ASTERISK-88
chan_dahdi: Add ADSI on-hook download support
ASTERISK-83
res_pjsip_device_features: Add forwarding and DND synchronization
ASTERISK-19
chan_dahdi: Remove sig_analog paths
ASTERISK-144
chan_pjsip: Add support for directrtpsetup
PHREAKSCRIPT-65
wanpipe: wanpipe modules fail to load
DAHLIN-9
No rule to make target 'vpmadt032_loader/vpmadt032_x86_64.o'
ASTERISK-130
Verify that res_xmpp can compile and be used
LBBS-64
mod_operator: Crash with more than 64 options?
ASTERISK-71
app_if: ElseIf executed even if If is true
PHREAKNET-42
Provisioning fails for lines with certain features
PHREAKNET-40
Recent Change provisioning bug increments device name by 1
LBBS-105
config.c: Configs can be purged while being used
LBBS-70
mod_smtp_delivery_external: Use SRS for externally forwarded messages
PHREAKNET-52
Cisco end of CSR signing support
DAHLIN-7
Mega-issue to upstream out-of-tree DAHDI patches
ASTERISK-97
func_groupcount: Add group vars
PHREAKNET-35
TSPS improvements
PHREAKNET-23
Wakeup calls not dialling at scheduled time
ASTERISK-101
func_tonedetect: 2600 Hz detection not working or suboptimal
ASTERISK-147
res_smdi: Allow Asterisk to be the SMDI server
LBBS-6
Add MenuScript, a menu system scripting engine
SLACK-5
Failed to receive reply... when message sent
ASTERISK-131
chan_dahdi: Automatically update time when DST starts/ends
ASTERISK-115
chan_iax2: Some pattern matches ignored if included in incoming context
ASTERISK-112
chan_dahdi: Raw power ring audible on recall ring from IAX2 to DAHDI
LBBS-32
mod_spamassassin: Improve default spam handling
ASTERISK-66
app_sf: ReceiveSF not detecting incoming SF
EVERGREEN-1
Use default identity per folder
PHREAKSCRIPT-70
app_tap: Add TAP support to Asterisk
ASTERISK-140
res_pjsip_session: Add support for SIP-ISUP
ASTERISK-110
chan_iax2: Implement MWI
ASTERISK-75
chan_dahdi: Add Call Hold feature
LBBS-92
Gmail bug causes disconnect after MOVE of certain messages
ASTERISK-80
app_record: Add RECORD_TIME function
LBBS-95
mod_mailscript: Add ADDFLAG action
LBBS-97
system.c: Evaluate shell syntax/variables when launching programs
LBBS-88
net_imap: IDLE data not being processed in realtime
ASTERISK-134
chan_dahdi: Improve configuration validation
INTERLINKED-20
Closing multiple issues simultaneously doesn't work
PHREAKSCRIPT-39
Add optional flag to not update system first
LBBS-58
net_irc: Make ping interval adjustable
DAHLIN-1
Makefile: remove update target
LBBS-71
Limit registrations from same IP within a certain amount of time
ASTERISK-63
Upstream certain PhreakScript modules
PHREAKSCRIPT-43
Add spanconfig command
ASTERISK-106
chan_pjsip: Modify From header appropriately for unavailable presentation
PHREAKNET-47
Add automation for bill mailings
ASTERISK-123
app_voicemail: Add ability to disable "thank-you" when ending voicemail
ASTERISK-104
Improve dahdi show channels output
ASTERISK-64
chan_dahdi: autoreoriginate doesn't work if caller hung up on
LBBS-66
logger: Add rate limiting of log messages
INTERLINKED-16
Add option to not be notified about user's own issues
LBBS-46
Block malicious mail servers after repeated failures
ASTERISK-52
dsp.c: Add ast_freq_reset
ASTERISK-73
chan_dahdi: Hunt to next trunk in group if busy
ASTERISK-65
sig_analog: Allow simple switch to time out to dialplan
LBBS-11
door_evergreen: Use isonetexec instead of exec
LBBS-7
Fix backspace detection/handling
ASTERISK-37
chan_pjsip: CALLERID(ani2) not working
ASTERISK-36
res_pjsip_logger: Add filtering by username
ASTERISK-58
xml: Add config documentation
ASTERISK-84
Add 'core show variables' command
ASTERISK-74
chan_dahdi: Add AMI event for callwaiting
ASTERISK-8
Optimize boilerplate RSA to MD5 fallback
ASL-4
Add framehook module to convert between mute/unmute and radio key/unkey
ASTERISK-32
chan_dahdi: Allow Call Forwarding to be set/get programatically
ASTERISK-27
chan_dahdi: add IS_FXO_SIG macro
ASTERISK-72
chan_dahdi: Move documentation to separate file
SLACK-2
README: Add missing pre-reqs
ASTERISK-55
chan_dahdi: add NUM_ANALOG_SUBS
ASTERISK-42
sig_pri: Add CLI description
ASTERISK-34
app_queue: Allow setting context at runtime
ASTERISK-30
Add ast_channel_tech_name_match function
ASTERISK-29
chan_iax2: Add ${CHANNEL(authmethod)}
ASTERISK-15
chan_dahdi: Allow sending SDMF Caller ID
ASTERISK-98
Add hangup callbacks
ASTERISK-47
res_pjsip_session: Warn if no shared codecs
ASTERISK-18
func_frame_drop: Simplify and improve
PHREAKSCRIPT-49
wanpipe doesn't compile above 6.1 kernel
ASTERISK-86
app_confbridge: Channel can join wrong bridge due to race condition
INTERLINKED-6
PhreakNet Forums
DAHLIN-14
DAHDI modules fail to load with error: loading out-of-tree module taints kernel
DAHLIN-6
Frame relay broken
LBBS-101
io_tls: Automatically reload TLS certificates and non-disruptively
LBBS-74
net_ssh: Sessions persist even when they no longer exist
DAHLIN-10
Allow enabling EMPULSE and EMFLASH simultaneously
LBBS-82
localtime_r deadlock
ASTERISK-135
Mutex errors on FreeBSD
LBBS-41
socket.c: SEGV in bbs_node_readline
LBBS-69
net_ssh: SFTP uploads fail with WinSCP
PHREAKSCRIPT-19
app_verify: Double free
PHREAKNET-14
1+ calls do not work for single numbers
LBBS-47
Email enhancements
EVERGREEN-3
Add NNTP support for newsgroups
LBBS-48
net_irc: Support multi-server networks
LBBS-90
mod_smtp_delivery_external: Improve queuing process
PHREAKNET-39
Splice Fred Covington prompts for speaking clock
WSSMAIL-5
Add full attachment support
ASTERISK-129
core: Add ref/unref for ast_moh callbacks
DAHLIN-8
Readd native SF support
PHREAKNET-49
ML model for 3-slot coin detection
PHREAKSCRIPT-45
TDMoIP driver module
PHREAKSCRIPT-44
Finish ADSI applications
PHREAKSCRIPT-41
Create virtual modem application using softmodem
PHREAKNET-41
Allow for more granular billing based on switch ZIP code
PHREAKNET-33
Finish TSPS web console
LBBS-72
mod_webdav: Add WebDAV support
ASTERISK-118
chan_iax2: Improve encryption support
DAHLIN-5
FXO rings off hook when rotary dialing on the line
ASTERISK-105
chan_dahdi: Add CLI command to display line voltages
PHREAKSCRIPT-37
app_softmodem: Support speeds higher than 2400bps
WSSMAIL-13
Improve multi-INBOX navigation
LBBS-56
net_snpp: Add Simple Network Paging Protocol support
LBBS-38
mod_smtp_mailing_lists: Allow dynamic membership
LBBS-36
net_telnet: Improve protocol support
LBBS-35
net_acap: Add ACAP protocol support
WSSMAIL-4
Add PHPMailer support for format=flowed
ASTERISK-7
Improve sound control capabilities
LBBS-30
net_nntp: Complete overhaul/rewrite to use maildirs
LBBS-49
Add functionality expected of a traditional BBS package
ASTERISK-99
pjsip: Add Cisco CUCM patch functionality
LBBS-34
net_xmpp: Add XMPP protocol support
LBBS-33
net_imap: Add/standardize commands to modify or purge keywords
ASTERISK-57
bridging: Make DAHDI, always softmix bridging modules
LBBS-91
readline.c: Crash in memmove
EVERGREEN-2
Navigation breaks when requirefromhelomatch=no in LBBS
DOCS-1
Kickstart the wiki
ASTERISK-87
asterisk.c: Prevent creation of duplicate Asterisk processes
PHREAKNET-36
Trunking integration with Phil McCarter
LBBS-106
net_ssh: Soft assertion due to data during shutdown
PHREAKNET-58
TSPS phrasing is not correct
PHREAKSCRIPT-62
res_smdr_whozz: Initialization usually fails in practice
DAHTOOL-3
Compilation warnings on 32-bit (i686)
PHREAKSCRIPT-33
verify.conf: Flag invalid NXXs as illegitimate for NANPA calls
LBBS-61
net_imap: Soft assertion in parse_flags_string
LBBS-63
net_imap, io_compress: Spurious warnings if quota exceeded
LBBS-39
net_smtp: Occasional memory corruption on email delivery
LBBS-37
Restrict outgoing port 25 from containers while allowing other traffic
LBBS-23
net_smtp: DMARC reports not sent due to rejection of localhost
LBBS-20
node.c: Occasional race conditions during node shutdown cause deadlock
LBBS-17
Temporary files not always cleaned up
LBBS-79
Makefile: cp -n is deprecated
PHREAKSCRIPT-35
app_mail: SendMail returns SUCCESS
LBBS-51
General TDD improvements
PHREAKSCRIPT-23
res_phreaknet: Increase cURL timeout
ASTERISK-94
app_chanspy: Fix bad audio with single direction operation
ASTERISK-76
app_dial: Allow MOH until progress received
LBBS-28
mod_discord: Warn users if IRC users are not online
PHREAKSCRIPT-16
app_selective: Missing pause after add/delete/instructions prompt
DAHTOOL-2
dahdi_cfg: Compiler warnings
ASTERISK-43
pbx_builtins: allow Answer to specify the channel
ASTERISK-35
sig_analog: Fix buffer overflow
DAHLIN-11
Use dev_addr_set instead of directly modifying const buffer
PHREAKSCRIPT-58
sig_analog: Allow hearpulsing gain to be adjusted
ASTERISK-128
Rename ast_sip_presence_xml_ functions
ASTERISK-127
func_codecs: view/update codecs
WSSMAIL-15
Allow navigating messages using arrow keys
PHREAKSCRIPT-29
res_phreaknet: Don't try making API requests if not a PhreakNet node
LBBS-59
Add HTTP endpoint for updating IRC presence automatically
WSSMAIL-14
Checkbox range selection doesn't always work reliably
SLACK-3
examples: Add example program to log everything to a CSV
PHREAKSCRIPT-22
Add framehook to display dialed digits
PHREAKSCRIPT-21
app_looparound: Add LoopAround application
LBBS-45
Use isoexec whenever possible
PHREAKSCRIPT-17
res_phreaknet: iax.conf, et. al. are truncated when there is no disk space left
LBBS-43
mod_discord: Improve handling of in-thread replies
LBBS-40
net_smtp: Add additional loop avoidance mechanisms
LBBS-29
net_irc: Add reminder bot
ASTERISK-69
res_cli_originate: Allow specifying Caller ID on CLI
DAHLIN-3
build: Compiler warnings
LBBS-10
mod_sysop: Allow modifying user info from console
LBBS-8
net_imap: Accounts occasionally fail to load or are reordered
LBBS-5
tests: Add TLS tests
LBBS-4
tests: Add tests that establish remote console connections
ASTERISK-53
formats: add ulaw/alaw WAV support
ASTERISK-51
app_originate: Allow spooling future calls
INTERLINKED-4
InterLinked Issues API
PHREAKNET-7
Subscriber Service Disconnect Request Option
DAHLIN-15
Add support for 20pps dial pulsing
INTERLINKED-17
Blog: Issues with tag editing and viewing
PHREAKSCRIPT-69
res_alarmsystem: Add additional environmental integration
WSSMAIL-8
Add NNTP support and IRC integration
LBBS-27
mod_irc_relay: Allow relaying of away/here status
LBBS-89
mod_sysop: Improve history navigation and tab completion
ASTERISK-126
chan_iax2: Add fixed jitterbuffer
INTERLINKED-15
Improve paging API
PHREAKNET-45
Operator system PSPs are outdated
LBBS-52
net_smtp: Add limited support for VRFY and EXPN
PHREAKSCRIPT-25
chan_sccp no longer compiles
PHREAKSCRIPT-18
Add better test coverage for 32-bit systems
WSSMAIL-7
Add ability for zero-trust type authentication
LBBS-24
build: Pre-reqs don't compile on Fedora
LBBS-9
mod_webmail: Improve MIME parsing to extract HTML/PT components
ASTERISK-56
res_musiconhold: Add recursive files support
PHREAKNET-32
Set up Millennium Manager
PHREAKNET-24
[REQ] TTY Telegrams
ASTERISK-11
chan_dahdi: Add wink guard
PHREAKNET-20
Billing based on individual CLLI zip codes
PHREAKNET-1
Add third-party billing integration
PHREAKNET-10
Enhanced utilization of Feature Group D

← All Issues || New Issue →

Sort Normal || Priority

Details


A while ago while testing, I inadvertently had a bug that resulted in non-alphanumeric characters in a keyword for a particular mailbox. This exposed a bug in the libetpan IMAP client library where it could no longer access this mailbox due to a parsing error in the library, since this malformed keyword would ever after appears in the PERMANENTFLAGS response when the mailbox was selected. However, the larger issue was there is no current mechanism in the IMAP protocol to purge such a malformed keyword from a mailbox. I was fortunate I could contact the server operator by email (small local mail server) and ask him to remove the keyword. However, in the real world, most users do not have this luxury or ability.

The underlying "problem" is that IMAP as a protocol does not dictate the mailbox storage format. maildir++ is a common one, and one that is the focus here. When keywords are removed from messages using the STORE command, the server is not obligated to remove this keyword from it keyword mapping for that mailbox, even if no messages are using it - certainly, neither my IMAP server implementation nor the one used by the server mentioned above do this. This creates a small window of opportunity for things to go very bad for a user - even though it's the library's fault for choking on a PERMANENTFLAGS it doesn't expect, in the spirit of robustness, it should be possible to fix these after the fact. The only remedy today is quite nuclear: manually remove the keyword from all messages using STORE, move them to another mailbox, and then delete the original mailbox, renaming the new mailbox afterwards. This may not always be possible or practical in all circumstances.

To remedy this, I propose two new IMAP keywords, RENAMEKEYWORD and DELETEKEYWORD. Strictly speaking, only DELETEKEYWORD is necessary, since a keyword can be deleted and recreated automatically as needed by the IMAP server. However, a user may find it advantageous to be able to rename a keyword for servers using the maildir format, which normalizes keyword names to a single letter or identifier. However, this is implementation dependent, so RENAMEKEYWORD support is optional by the server, and these capabilities will be advertised separately.

Both commands are only possible in the selected state for a particular mailbox. The DELETEKEYWORD command will accept, as a single argument, the keyword to delete. The RENAMEKEYWORD command accepts as arguments the old keyword name and the new keyword name. Standard IMAP responses apply - BAD, NO, and OK, depending on the outcome. If there are messages that are currently using a keyword, the server SHOULD automatically remove this keyword from all such messages as if a STORE operation were issued prior.

It is not the author's intention that mail clients generally offer a graphical facility for using these keywords, which are intended more as a debugging and administrative mechanism for troubleshooting and maintenance purposes. Any skilled user could connect to their IMAP server in a terminal session and issue these commands manually to get them out of a jam. However, nothing certainly stops an IMAP client from including a menu that would allow the user to more easily rename and delete keywords. A natural extension to this is a LISTKEYWORDS command, but that isn't as high a priority for me to see happen.

Another use case for keywords like DELETEKEYWORD is not just to remove keywords that created accidentally or malformed but to, perhaps over time, allow users to manually do "housekeeping" by deleting keywords from the keyword mapping that are no longer being used. But this is a slightly different use case that may be better suited by a dedicated command to purge keywords that are no longer being used from the keyword mapping, or perhaps DELETEKEYWORD should not normally succeed if the keyword in question is being used by any message in the mailbox, which may be the better solution since it would not be difficult to do a STORE 1:* first to remove the keyword from all messages and THEN delete it. Thus, refusing to delete keywords in use serves as an additional safety mechanism.

While I can implement this independently in the LBBS IMAP server relatively easily, I think the problem is broad enough that it makes sense to submit this to an IETF working group for possible standardization. See https://datatracker.ietf.org/wg/extra/about/


Comments

You must be logged in to leave a comment.